-- Logs begin at Fri 2022-01-21 13:08:52 UTC, end at Fri 2022-01-21 14:04:58 UTC. -- Jan 21 13:38:46.753227 dv-cinder-820164-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 21 13:38:46.762780 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 21 13:38:46 2022] *** Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: nodename: dv-cinder-820164-2-iscsi Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: machine: x86_64 Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: clock source: unix Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: pcre jit disabled Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: detected number of CPU cores: 4 Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: current working directory: / Jan 21 13:38:46.764764 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: detected binary path: /usr/bin/uwsgi-core Jan 21 13:38:46.765475 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: your processes number limit is 47680 Jan 21 13:38:46.765475 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: your memory page size is 4096 bytes Jan 21 13:38:46.765475 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: detected max file descriptor number: 2048 Jan 21 13:38:46.765475 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: lock engine: pthread robust mutexes Jan 21 13:38:46.765475 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: thunder lock: enabled Jan 21 13:38:46.765475 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 21 13:38:46.765475 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 21 13:38:46.810251 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: Python main interpreter initialized at 0x55c87536d9c0 Jan 21 13:38:46.810251 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: python threads support enabled Jan 21 13:38:46.810251 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: your server socket listen backlog is limited to 100 connections Jan 21 13:38:46.810251 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: your mercy for graceful operations on workers is 90 seconds Jan 21 13:38:46.810612 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: mapped 403077 bytes (393 KB) for 2 cores Jan 21 13:38:46.810691 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: *** Operational MODE: preforking *** Jan 21 13:38:46.810906 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: *** uWSGI is running in multiple interpreter mode *** Jan 21 13:38:46.810906 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: spawned uWSGI master process (pid: 108370) Jan 21 13:38:46.811091 dv-cinder-820164-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 21 13:38:46.813498 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: spawned uWSGI worker 1 (pid: 108371, cores: 1) Jan 21 13:38:46.813498 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: spawned uWSGI worker 2 (pid: 108372, cores: 1) Jan 21 13:38:46.813498 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 21 13:38:48.602900 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:38:48.602900 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: from cryptography.utils import int_from_bytes Jan 21 13:38:48.603577 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:38:48.603577 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: from cryptography.utils import int_from_bytes Jan 21 13:38:48.626465 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:38:48.626465 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: from cryptography.utils import int_from_bytes Jan 21 13:38:48.626970 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:38:48.626970 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: from cryptography.utils import int_from_bytes Jan 21 13:38:51.203080 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 13:38:51.203631 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 13:38:51.203825 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 13:38:51.204123 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 13:38:51.204492 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 13:38:51.204577 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 13:38:51.204695 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 13:38:51.204839 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.204931 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 13:38:51.205168 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.205256 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 13:38:51.205493 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.205585 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 13:38:51.205815 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.205907 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.206150 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.206242 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.206465 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.206555 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.206787 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.206884 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.207109 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.207200 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.207440 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.207531 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.207704 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.207868 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.208022 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.208106 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.208348 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820164-2-iscsi {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.208438 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.208675 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.208772 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.208995 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.209078 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.209306 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.209389 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820164-2-iscsi {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.209631 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.209716 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.209936 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.210026 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.210249 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.210340 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.210558 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.210641 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.211042 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.211147 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.211381 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.211552 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.211698 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.211863 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.212180 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.212316 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.212517 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.212683 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.212860 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.212957 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.213170 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.213259 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.213495 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.213621 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.213807 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.213947 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.214131 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.214258 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.214446 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.214579 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.214855 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820164-2-iscsi {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.214949 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.215176 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.215277 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.215496 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.215584 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.215816 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.215908 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820164-2-iscsi {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.216208 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.216297 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.216530 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.216644 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.216876 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.217013 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.217183 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.217297 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.217516 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.217620 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.217832 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.217945 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.218163 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.218265 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.218487 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.218572 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.218811 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.218896 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.219139 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.219234 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.219452 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.219545 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.219767 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.219858 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.220082 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.220167 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.220407 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.220497 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.220741 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.220830 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.221054 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.221165 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.221307 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.221439 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.221623 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.221715 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.221950 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.222035 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.222214 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.222296 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.222528 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.222620 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.222837 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.222922 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.223093 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.223183 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.223420 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.223524 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.223734 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.223818 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.223993 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.224078 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.224321 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.224407 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.224668 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.224766 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.224984 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.225069 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.225297 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.225389 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.225609 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.225702 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.225921 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.226013 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.226233 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.226317 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.227073 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.227256 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.227382 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.227710 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.227797 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.228025 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.228105 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.228351 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.228441 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.228750 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.228849 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.229017 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.229099 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.229329 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.229420 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.229673 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.229759 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.229996 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.230101 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.230309 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.230393 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.230632 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.230717 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.230954 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.231061 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.231264 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.231360 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.231573 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.231664 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.231883 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.231974 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.232206 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.232299 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.232532 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.232636 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.232870 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.232954 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.233123 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.233220 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.233429 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.233520 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.233737 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.233828 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.234060 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.234152 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.234364 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.234447 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.234675 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.234759 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.234984 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.235075 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.235290 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.235378 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.235598 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.235689 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.235908 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.235999 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.236216 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.236301 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.236520 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.236654 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.236855 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.236939 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.237165 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.237256 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.237474 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.237601 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.237780 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.237864 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.238088 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.238170 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.238405 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.238488 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.238719 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.238804 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.239027 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.239110 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.239334 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.239431 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.239642 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.239726 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.239950 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.240043 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.240267 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.240362 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.240574 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.240676 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.240907 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.240991 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.241217 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.241313 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.241527 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.241646 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.241836 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.241921 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.242727 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.242835 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.243041 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.243147 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.243353 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.243450 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.243674 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.243838 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.243982 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.244074 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.244294 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.244384 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.244650 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.244757 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.244952 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.245037 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.245260 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.245344 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.245567 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.245659 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.245876 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.245961 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.246184 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.246278 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.246493 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.246585 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.246802 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.246886 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.247109 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.247202 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.247413 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.247496 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.247720 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.247810 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.248033 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.248118 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.248350 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.248434 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.248682 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.248782 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.248993 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.249083 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.249324 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.249409 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.249636 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.249725 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.249949 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.250035 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.250262 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.250353 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.250589 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:38:51.250673 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.250927 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.251019 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.251266 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.251398 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.251591 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.251680 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.251912 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.252004 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.252234 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.252318 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.252568 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.252674 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.252912 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.253013 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.253229 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.253320 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.253547 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.253630 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.253874 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.253965 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.254190 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.254273 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.254510 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.254594 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.254828 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.254912 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.255147 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.255250 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.255470 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.255554 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.255783 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.255876 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.256107 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.256192 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.256426 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.256510 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.256780 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.256870 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.257099 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.257184 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.257421 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.257511 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.258321 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.258528 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.258659 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.258733 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.258981 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.259073 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.259329 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.259415 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.259677 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.259763 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.259995 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.260087 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.260316 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.260400 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.260655 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.260744 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.260989 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.261085 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.261304 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.261388 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.261624 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.261720 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.261942 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.262034 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.262276 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.262359 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.262593 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.262675 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.262905 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.262997 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.263217 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.263301 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.263526 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.263611 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.263844 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.263929 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.264155 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.264239 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.264465 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.264548 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.264822 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.264908 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.265136 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.265220 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.265474 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.265558 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.265786 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.265870 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.266102 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.266186 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.266417 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.266499 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.266726 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.266810 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.267044 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.267128 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.267358 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.267522 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.267667 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.267752 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.267978 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.268069 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.268302 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.268436 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.268657 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.268766 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.268943 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.269027 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.269266 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.269358 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.269578 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.269662 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.269886 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.269976 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.270200 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.270292 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.270514 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.270598 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.270826 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.270910 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.271147 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.271233 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.271461 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.271545 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.271777 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.271876 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.272095 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.272184 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.272425 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.272510 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.272760 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.272858 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.273079 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.273170 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.273967 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.274062 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.274372 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.274456 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.274686 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.274778 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.275002 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.275086 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.275314 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.275406 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.275625 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.275709 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.275936 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.276020 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.276250 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.276347 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.276558 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.276670 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.276893 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.276978 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.277198 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.277290 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.277508 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.277594 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.277817 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.277910 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.278133 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.278226 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.278448 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.278551 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.278759 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.278850 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.279071 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.279169 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.279383 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.279476 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.279696 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.279779 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.280008 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.280094 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.280321 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.280405 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.280649 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.280737 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.281001 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.281087 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.281580 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.281681 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.281911 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.281994 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.282232 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.282321 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.282549 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.282640 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.282867 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.282964 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.283183 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.283266 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.283499 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.283589 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.283816 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.283907 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.284131 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.284214 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.284446 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.284529 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.284786 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.284890 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.285113 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.285197 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.285425 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.285508 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.285749 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.285842 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.286057 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.286140 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.286376 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.286461 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.286689 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.286781 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.287015 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.287107 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.287327 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.287412 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.287650 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.287735 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.287965 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.288048 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.288283 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.288367 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.288602 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.288733 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.288977 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.289116 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.289284 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.289526 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.289619 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.289855 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.289941 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.290175 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.290259 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.290493 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.290589 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.290812 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.290901 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.291132 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.291217 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.291443 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.291542 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.291762 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.291845 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.292070 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.292161 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.292387 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.292479 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.292736 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.292824 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.293054 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.293138 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.293372 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.293465 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.293681 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.293764 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.294001 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.294086 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.294314 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.294398 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.294627 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.294711 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.294943 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.295028 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.295254 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.295345 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.295564 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.295648 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.295878 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.295970 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.296197 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.296289 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.296511 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.296595 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.296848 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.296944 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.297159 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.297250 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.297477 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.297569 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.297791 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.297951 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.298100 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.298185 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.298409 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.298500 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.298723 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.298816 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.299044 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.299129 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.299357 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.299461 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.299664 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.299748 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.299974 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.300058 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.300288 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.300387 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.300597 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.300714 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.300943 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.301027 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.301253 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.301335 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.301562 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.301655 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.301872 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.301956 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.302181 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.302270 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.302508 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.302600 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.302822 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.302909 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.303129 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.303221 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.303435 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.303546 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.303744 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.303836 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.304064 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.304156 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.304388 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.304485 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.304753 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.304863 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.305070 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.305189 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.305397 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.305517 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.305716 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.305832 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.306029 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.306151 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.306344 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.306466 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.306661 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.306781 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.306978 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.307108 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.307294 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.307429 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.307622 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.307732 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.307936 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.308041 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.308250 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.308361 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.308566 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.308686 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.308907 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.308997 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.309227 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.309319 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.309547 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.309632 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.309911 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.310116 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.310224 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.310451 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.310542 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.310771 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.310855 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.311094 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.311178 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.311417 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.311688 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.311785 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.312030 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.312127 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.312400 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.312497 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.312699 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.312812 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.313016 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.313100 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.313323 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.313408 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.313633 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.313729 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.313943 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.314027 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.314255 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.314339 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.314563 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.314649 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.314871 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.314956 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.315181 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.315265 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.315491 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.315574 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.315800 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.315891 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.316106 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.316196 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.316416 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.316508 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.316756 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.316844 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.317073 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.317167 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.317381 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.317472 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.317687 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.317769 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.317995 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.318088 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.318319 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.318416 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.318632 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.318725 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.318938 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.319028 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.319245 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.319335 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.319555 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.319645 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.319883 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.319967 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.320760 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.320858 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.321102 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.321189 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.321421 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.321505 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.321731 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.321824 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.322058 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.322188 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.322367 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.322468 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.322697 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.322869 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.323004 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.323096 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.323310 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.323396 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.323618 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.323711 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.323930 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.324015 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.324241 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.324325 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.324547 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.324692 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.324886 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.324971 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.325194 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.325277 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.325505 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.325589 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.325814 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.325898 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.326117 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.326200 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.326429 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.326514 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.326735 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.326820 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.327046 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.327130 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.327355 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.327445 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.327659 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.327742 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.327961 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.328044 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.328268 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.328352 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.328576 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.328680 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.328906 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.329043 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.329212 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.329296 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.329519 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.329604 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.329834 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.329926 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.330141 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.330224 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.330445 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.330540 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.330751 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.330845 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.331057 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.331141 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.331363 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.331446 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.331669 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.331762 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.331976 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.332060 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.332283 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.332368 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.332587 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.332790 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.332916 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.333000 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.333221 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.333306 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.333525 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.333618 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.333831 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.333922 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.334142 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.334231 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.334450 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.334542 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.334761 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.334845 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.335109 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.335202 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.335373 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.335458 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.335676 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.336367 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.336544 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.336661 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.336879 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.336965 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.337190 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.337282 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.337494 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.337590 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.337798 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.337889 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.338105 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.338189 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.338409 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.338502 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.338715 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.338800 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.339020 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.339148 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.339327 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.339422 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.339636 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.339719 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.339941 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.340024 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.340243 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.340327 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.340569 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.340671 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.340902 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.340986 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.341210 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.341294 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.341519 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.341603 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.341826 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.341918 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.342164 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.342248 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.342471 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.342557 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.342791 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.342900 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.343108 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.343205 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.343415 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.343508 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.343733 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.343835 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.344047 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.344132 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.344363 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.344448 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.344691 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.344791 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.345000 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.345092 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.345322 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.345405 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.345636 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.345728 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.345949 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.346035 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.346259 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.346342 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.346569 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.346662 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.346897 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.346988 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.347202 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.347285 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.347513 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.347610 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.347827 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.347911 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.348137 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.348222 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.348450 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.348542 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.348809 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.348893 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.349108 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.349182 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.349423 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.349508 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.349734 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.349818 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.350047 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.350139 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.350358 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.350442 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.350667 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.350750 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.350979 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.351063 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.351290 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.351400 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.351626 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.351781 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.352019 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.352190 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.352272 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.352347 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.352544 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.352676 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.352886 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.353013 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.353196 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.353292 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.353506 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.353589 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.353814 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.353909 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.354125 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.354241 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.354440 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.354556 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.354749 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.354873 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.355070 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.355183 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.355383 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.355499 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.355814 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.355900 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.356133 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.356219 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.356450 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.356533 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.356792 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.356879 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.357114 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.357210 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.357477 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.357561 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.357807 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.357899 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.358120 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.358204 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.358429 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.358512 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.358733 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.358857 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.359046 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.359176 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.359379 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.359495 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.359690 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.359813 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.359998 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.360123 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.360308 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.360433 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.360657 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.360772 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.360967 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.361091 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.361292 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.361387 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.361702 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.361786 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.362015 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.362106 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.362324 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.362416 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.362642 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.362725 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.362983 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.363115 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.363345 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.363430 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.363672 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.363762 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.363990 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.364072 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.364317 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.364401 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.364651 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.364752 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.364974 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.365065 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.365288 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.365380 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.365615 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.365705 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.365942 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.366032 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.366259 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.366349 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.366576 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.366674 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.366885 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.366984 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.367261 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.367358 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.367593 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.367683 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.367911 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.368010 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.368232 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.368322 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.368543 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.368723 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.368901 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.369056 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.369231 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.369377 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.369551 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.369705 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.369881 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.370036 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.370300 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.370394 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.370630 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.370715 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.370945 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.371030 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.371255 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.371348 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.371565 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.371650 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.371888 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.371981 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.372194 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.372279 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.372505 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.372596 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.372842 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.372931 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.373157 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.373254 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.373468 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.373560 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.373777 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.373867 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.374093 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.374191 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.374399 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.374496 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.374710 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.374799 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.375022 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.375113 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.375332 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.375423 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.375658 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.375756 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.375967 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.376056 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.376291 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.376381 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.376624 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.376732 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.376933 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.377023 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.377241 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.377331 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.377553 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.377652 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.377878 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.377968 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.378193 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.378283 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.378501 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.378600 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.378817 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.378908 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.379126 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.379224 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.379458 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.379567 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.379772 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.379862 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.380097 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.380188 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.380414 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.380503 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.380760 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.380851 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.381089 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.381180 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.381397 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.381488 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.381705 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.381795 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.382018 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.382122 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.382326 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.382416 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.383264 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.383367 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.383532 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.383676 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.383848 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.383991 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.384162 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.384302 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.384476 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.384632 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.384809 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.384946 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.385123 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.385275 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.385438 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.385588 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.385747 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.385916 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.386055 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.386228 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.386366 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.386537 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.386694 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.386848 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.387005 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.387154 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.387334 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.387502 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.387649 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.387811 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.387967 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.388147 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.388278 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.388469 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.388587 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.388823 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.388962 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.389156 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.389279 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.389472 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.389627 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.389803 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.389944 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.390129 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.390272 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.390449 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.390606 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.390767 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.390924 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.391087 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.391256 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.391406 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.391579 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.391725 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.391901 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.392044 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.392223 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.392359 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.392545 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.392703 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.392892 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.393022 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.393215 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.393421 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.393519 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.393840 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.393925 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.394162 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.394247 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.394476 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.394560 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.394794 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.394904 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.395108 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.395315 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.395409 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.395653 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.395738 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.395977 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.396064 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.396300 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.396392 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.396633 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.396722 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.396956 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.397041 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.397287 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.397373 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.397616 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.397708 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.397947 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.398039 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.398945 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.399154 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.399281 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.399488 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.399606 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.399829 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.399934 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.400168 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.400261 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.400506 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.400592 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.400891 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.400981 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.401220 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.401358 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.401546 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.401639 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.401866 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.401950 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.402187 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.402279 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.402504 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.402587 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.402822 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.402913 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.403142 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.403228 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.403491 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.403595 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.403772 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.403857 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.404085 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.404171 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.404402 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.404487 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.404758 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.404894 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.405068 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.405161 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.405392 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.405477 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.405711 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.405806 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.406027 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.406111 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.406609 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.406701 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.406927 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.407019 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.407260 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.407441 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.407602 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.407761 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.407931 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.408099 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.408254 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.408430 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.408576 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.408784 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.408921 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.409108 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.409429 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.409512 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.409755 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.409839 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.410070 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.410157 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.410380 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.410464 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.410695 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.410779 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.411007 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.411093 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.411316 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.411400 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.411644 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.411729 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.411958 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.412044 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.412269 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.412354 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.412593 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.412733 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.412929 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.413015 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.413243 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.413463 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.413562 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.413821 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.413918 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.414168 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.414294 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.414509 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.414632 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.414838 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.414967 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.415162 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.415449 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.415536 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.415794 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.415878 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.416109 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.416195 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.416423 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.416508 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.416770 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.416860 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.417089 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.417174 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.417400 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.417486 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.417710 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.417796 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.418031 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.418157 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.418348 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.418442 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.418655 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.418740 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.418970 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.419056 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.419280 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.419371 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.419593 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.419677 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.419909 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.419992 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.420221 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.420313 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.420532 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.420664 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.420874 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.420969 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.421183 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.421276 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.421491 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.421585 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.421802 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.421887 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.422111 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.422204 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.422421 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.422503 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.422729 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.422812 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.423042 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.423299 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.423397 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.423479 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.423653 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.423753 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.423964 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.424074 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.424277 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.424363 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.424585 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.424730 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.424925 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.425012 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.425233 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.425317 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.425543 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.425635 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.425854 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.425939 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.426166 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.426257 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.426476 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.426560 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.426797 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.426881 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.427107 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.427190 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.427420 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.427513 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.427744 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.427829 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.428062 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.428271 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.428393 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.428683 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.428785 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.429007 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.429093 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.429345 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.429430 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.429774 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.429869 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.430275 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.430360 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.430594 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.430759 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.430907 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.431018 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.431237 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.431359 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.431558 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.431699 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.431877 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.432013 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.432196 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.432327 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.432513 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.432659 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.432856 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.432992 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.433172 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.433312 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.433489 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.433631 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.433806 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.433964 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.434122 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.434268 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.434437 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.434585 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.434758 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.434903 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.435156 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.435257 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.435424 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.435518 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.435748 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.435841 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.436068 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.436160 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.436391 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.436477 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.436731 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.436822 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.437048 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.437143 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.437363 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.437448 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.437677 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.437762 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.438000 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.438156 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.438334 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.438428 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.438649 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.438732 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.438955 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.439048 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.439272 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.439357 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.439599 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.439684 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.439944 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.440038 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.440268 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.440352 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.440582 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.440700 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.440937 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.441023 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.441266 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.441354 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.441582 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.441674 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.441905 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.441997 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.442216 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.442309 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.442549 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.442642 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.442889 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.442974 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.443204 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.443296 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.443534 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.443631 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.443842 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.443973 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.444153 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.444240 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.444461 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.444555 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.444822 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.444909 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.445732 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.445842 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.446029 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.446165 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.446345 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.446489 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.446660 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.446817 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.446978 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.447134 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.447317 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.447460 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.447656 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.447773 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.447979 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.448099 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.448309 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.448426 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.448649 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.448771 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.448983 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.449077 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.449298 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.449390 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.449640 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.449747 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.449963 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.450050 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.450288 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.450431 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.450606 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.450704 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.450920 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.451003 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.451237 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.451323 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.451555 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.451647 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.451878 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.451963 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.452189 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.452272 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.452505 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.452601 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.452849 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.452946 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.453225 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.453332 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.453502 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.453645 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.453813 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.453897 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.454146 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.454270 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.454465 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.454562 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.454787 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.454872 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.455104 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.455188 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.455421 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.455512 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.455745 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.455850 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.456066 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.456169 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.456390 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.456483 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.456734 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.456828 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.457055 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.457156 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.457380 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.457472 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.457702 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.457793 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.458034 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.458133 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.458365 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.458455 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.458698 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.458799 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.459015 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.459104 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.459334 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.459425 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.459646 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.459761 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.459894 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 13:38:51.460020 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.460353 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.460713 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.461083 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.461568 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:38:51.461819 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 13:38:51.482266 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_db.sqlalchemy.engines [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:51.483509 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_db.sqlalchemy.engines [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:51.546111 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.context [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),015249c4-915d-4c7c-ba7f-761b11b5af70(cell1) {{(pid=108371) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 13:38:51.546347 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.context [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),015249c4-915d-4c7c-ba7f-761b11b5af70(cell1) {{(pid=108372) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 13:38:51.550316 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:38:51.550514 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_concurrency.lockutils [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:38:51.551869 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:38:51.552098 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_concurrency.lockutils [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:38:51.552690 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:38:51.552939 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_concurrency.lockutils [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:38:51.555155 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:38:51.555526 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_concurrency.lockutils [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:38:51.565609 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_db.sqlalchemy.engines [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:51.568402 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_db.sqlalchemy.engines [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:51.571488 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_db.sqlalchemy.engines [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:51.704927 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_db.sqlalchemy.engines [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:51.725878 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_db.sqlalchemy.engines [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:51.729241 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG oslo_db.sqlalchemy.engines [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:38:52.061315 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: WARNING keystonemiddleware.auth_token [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:38:52.062509 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: WARNING keystonemiddleware.auth_token [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:38:52.067740 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: WARNING keystonemiddleware.auth_token [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:38:52.069012 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: WARNING keystonemiddleware.auth_token [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:38:52.406054 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: WARNING keystonemiddleware.auth_token [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:38:52.410486 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: WARNING keystonemiddleware.auth_token [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:38:52.411430 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: WARNING keystonemiddleware.auth_token [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:38:52.416237 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: WARNING keystonemiddleware.auth_token [None req-e9acc5f5-bc0b-4243-9e67-8e5c2f5ff561 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:38:52.417902 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c87536d9c0 pid: 108372 (default app) Jan 21 13:38:52.419947 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:38:52.421126 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] 10.222.0.84 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jan 21 13:38:52.421529 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c87536d9c0 pid: 108371 (default app) Jan 21 13:38:52.421670 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 1/1] 10.222.0.84 () {50 vars in 788 bytes} [Fri Jan 21 13:38:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:17.470124 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:17.471797 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Jan 21 13:40:17.472343 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 2/2] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:17.904147 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-95ee0940-135b-4eb6-baee-7974205829bb admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:17.935909 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-95ee0940-135b-4eb6-baee-7974205829bb admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.456640 Jan 21 13:40:17.936880 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 1/3] 10.222.0.84 () {60 vars in 1291 bytes} [Fri Jan 21 13:40:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:40:20.220713 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:20.221694 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-afa0f14f-a982-4fcd-bf89-6f7f5a6eda66 None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jan 21 13:40:20.222349 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 3/4] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:20.286605 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-6e1f165b-5f86-4f55-bda2-c44f76513a1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "disk": 1, "swap": 0, "vcpus": 1}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:20.304723 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:40:20.304723 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: warnings.warn(msg) Jan 21 13:40:20.332453 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-6e1f165b-5f86-4f55-bda2-c44f76513a1f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104037 Jan 21 13:40:20.333140 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 2/5] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:40:20.548132 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-9c45df03-9924-4568-9753-87abb5108ca1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:20.550473 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:40:20.550473 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: warnings.warn(msg) Jan 21 13:40:20.599280 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-9c45df03-9924-4568-9753-87abb5108ca1 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.258477 Jan 21 13:40:20.600066 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 4/6] 10.222.0.84 () {64 vars in 1335 bytes} [Fri Jan 21 13:40:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:40:22.856955 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-6e1f165b-5f86-4f55-bda2-c44f76513a1f admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:22.858511 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-6e1f165b-5f86-4f55-bda2-c44f76513a1f admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Jan 21 13:40:22.859336 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 3/7] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:22.963102 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-1a3b1d81-8f8f-48d4-89f3-fff14a8b484f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "swap": 0}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:22.981129 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:40:22.981129 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: warnings.warn(msg) Jan 21 13:40:23.001537 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-1a3b1d81-8f8f-48d4-89f3-fff14a8b484f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135573 Jan 21 13:40:23.002280 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 5/8] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:40:23.013767 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-c877421c-e7d4-40de-840b-eb263d7e10fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:23.015222 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:40:23.015222 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: warnings.warn(msg) Jan 21 13:40:23.047975 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-c877421c-e7d4-40de-840b-eb263d7e10fd admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037705 Jan 21 13:40:23.048467 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 4/9] 10.222.0.84 () {64 vars in 1335 bytes} [Fri Jan 21 13:40:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:40:25.347295 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-1a3b1d81-8f8f-48d4-89f3-fff14a8b484f admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:25.350557 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-1a3b1d81-8f8f-48d4-89f3-fff14a8b484f admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002831 Jan 21 13:40:25.350855 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 6/10] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:25.412917 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-9f36cd31-428c-434a-86e2-a70ddcb1f882 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:25.434253 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-9f36cd31-428c-434a-86e2-a70ddcb1f882 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077231 Jan 21 13:40:25.435120 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 5/11] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:40:25.446379 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-5cb88ebd-f85e-4313-b15a-0efd5a3d4624 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:25.470884 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-5cb88ebd-f85e-4313-b15a-0efd5a3d4624 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027987 Jan 21 13:40:25.471626 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 7/12] 10.222.0.84 () {64 vars in 1335 bytes} [Fri Jan 21 13:40:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:40:27.903694 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-9f36cd31-428c-434a-86e2-a70ddcb1f882 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:27.904992 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-9f36cd31-428c-434a-86e2-a70ddcb1f882 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jan 21 13:40:27.905532 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 6/13] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:27.965161 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-d1f59e10-4b1f-4317-abb2-bfe01c6a471b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "ram": 2048, "disk": 10, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:27.984970 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-d1f59e10-4b1f-4317-abb2-bfe01c6a471b admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072972 Jan 21 13:40:27.985759 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 8/14] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:40:27.997918 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-edbba965-813d-4148-a174-92ad1ce3240e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:28.021526 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-edbba965-813d-4148-a174-92ad1ce3240e admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027312 Jan 21 13:40:28.022434 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 7/15] 10.222.0.84 () {64 vars in 1335 bytes} [Fri Jan 21 13:40:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:40:30.353695 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-d1f59e10-4b1f-4317-abb2-bfe01c6a471b admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:30.354695 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-d1f59e10-4b1f-4317-abb2-bfe01c6a471b admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jan 21 13:40:30.355094 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 9/16] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:30.417722 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-733cd8f4-e8c7-49d1-9cd6-ae2da0e7e88e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "name": "ds4G", "disk": 20}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:30.438471 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-733cd8f4-e8c7-49d1-9cd6-ae2da0e7e88e admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077367 Jan 21 13:40:30.439624 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 8/17] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:40:30.451722 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-dc52c97d-6575-4ed6-befd-275d44039eb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:30.477961 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-dc52c97d-6575-4ed6-befd-275d44039eb0 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029794 Jan 21 13:40:30.492012 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 10/18] 10.222.0.84 () {64 vars in 1335 bytes} [Fri Jan 21 13:40:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:40:32.771703 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-733cd8f4-e8c7-49d1-9cd6-ae2da0e7e88e admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:32.772747 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-733cd8f4-e8c7-49d1-9cd6-ae2da0e7e88e admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jan 21 13:40:32.773137 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 9/19] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:32.836061 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-0288e609-60e1-4c26-88d4-12ddc0226115 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:32.865708 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-0288e609-60e1-4c26-88d4-12ddc0226115 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086565 Jan 21 13:40:32.866356 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 11/20] 10.222.0.84 () {60 vars in 1291 bytes} [Fri Jan 21 13:40:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:40:35.229603 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-733cd8f4-e8c7-49d1-9cd6-ae2da0e7e88e admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:35.230890 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-733cd8f4-e8c7-49d1-9cd6-ae2da0e7e88e admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Jan 21 13:40:35.231425 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 10/21] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:35.290788 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-8479b83d-c302-4e43-b0aa-caeb6c3bd051 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:35.309972 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-8479b83d-c302-4e43-b0aa-caeb6c3bd051 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071198 Jan 21 13:40:35.310548 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 12/22] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:40:35.323534 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-9fd3e016-833e-40d0-85c0-d7e1cce6783a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:35.348282 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-9fd3e016-833e-40d0-85c0-d7e1cce6783a admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028335 Jan 21 13:40:35.348980 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 11/23] 10.222.0.84 () {64 vars in 1332 bytes} [Fri Jan 21 13:40:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:40:38.172584 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-8479b83d-c302-4e43-b0aa-caeb6c3bd051 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:38.174018 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-8479b83d-c302-4e43-b0aa-caeb6c3bd051 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jan 21 13:40:38.175181 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 13/24] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:38.235048 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-6644fa11-3b78-40ff-affc-57bb4c321594 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:38.254168 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-6644fa11-3b78-40ff-affc-57bb4c321594 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072994 Jan 21 13:40:38.255085 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 12/25] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:40:38.266689 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-97a645fe-6e92-4987-956e-8f52800cb880 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:38.289356 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-97a645fe-6e92-4987-956e-8f52800cb880 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026337 Jan 21 13:40:38.289914 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 14/26] 10.222.0.84 () {64 vars in 1332 bytes} [Fri Jan 21 13:40:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:40:40.546097 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-6644fa11-3b78-40ff-affc-57bb4c321594 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:40.547086 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-6644fa11-3b78-40ff-affc-57bb4c321594 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 21 13:40:40.547489 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 13/27] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:40.604163 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-187025ed-43de-408c-82d5-84d8b4a667fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "name": "m1.medium", "swap": 0, "vcpus": 2}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:40.621870 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-187025ed-43de-408c-82d5-84d8b4a667fd admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067927 Jan 21 13:40:40.622407 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 15/28] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:40:40.634214 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-8d83f927-8031-4162-b76f-ed2e909e9b08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:40.657412 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-8d83f927-8031-4162-b76f-ed2e909e9b08 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026766 Jan 21 13:40:40.657980 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 14/29] 10.222.0.84 () {64 vars in 1332 bytes} [Fri Jan 21 13:40:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:40:42.986618 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-187025ed-43de-408c-82d5-84d8b4a667fd admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:42.987635 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-187025ed-43de-408c-82d5-84d8b4a667fd admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jan 21 13:40:42.988036 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 16/30] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:43.049166 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-5a6f6de5-9ab9-4e44-9b15-c1a7fbb5c1ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:43.068513 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-5a6f6de5-9ab9-4e44-9b15-c1a7fbb5c1ce admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074520 Jan 21 13:40:43.072981 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 15/31] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:40:43.083257 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-2a8f84da-21d9-415a-ac57-321533ce4011 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:43.106906 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-2a8f84da-21d9-415a-ac57-321533ce4011 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029541 Jan 21 13:40:43.113357 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 17/32] 10.222.0.84 () {64 vars in 1332 bytes} [Fri Jan 21 13:40:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:40:45.457000 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-5a6f6de5-9ab9-4e44-9b15-c1a7fbb5c1ce admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:40:45.457995 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-5a6f6de5-9ab9-4e44-9b15-c1a7fbb5c1ce admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 21 13:40:45.458394 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 16/33] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:40:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:40:45.520021 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-eda14f52-f434-4d23-951d-e6dd8f0525fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:45.539336 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-eda14f52-f434-4d23-951d-e6dd8f0525fc admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074968 Jan 21 13:40:45.540121 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 18/34] 10.222.0.84 () {64 vars in 1282 bytes} [Fri Jan 21 13:40:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:40:45.552010 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-5e0ae314-3d7e-48b8-b2a4-f443984b676f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:40:45.578348 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-5e0ae314-3d7e-48b8-b2a4-f443984b676f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030181 Jan 21 13:40:45.579235 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 17/35] 10.222.0.84 () {64 vars in 1332 bytes} [Fri Jan 21 13:40:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:41:07.816167 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-eda14f52-f434-4d23-951d-e6dd8f0525fc admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:07.817267 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-eda14f52-f434-4d23-951d-e6dd8f0525fc admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002194 Jan 21 13:41:07.817670 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 19/36] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:07.875282 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-1d9d1f12-33f7-4252-a53f-e37a1e1bb7d2 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:07.892684 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-1d9d1f12-33f7-4252-a53f-e37a1e1bb7d2 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068812 Jan 21 13:41:07.893245 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 18/37] 10.222.0.84 () {60 vars in 1291 bytes} [Fri Jan 21 13:41:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:41:09.271545 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-eda14f52-f434-4d23-951d-e6dd8f0525fc admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:09.272557 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-eda14f52-f434-4d23-951d-e6dd8f0525fc admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jan 21 13:41:09.272980 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 20/38] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:09.465550 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-4f9975a9-41d3-46ce-9a8f-fddd7dea9a8d admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:09.471007 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.wsgi [None req-4f9975a9-41d3-46ce-9a8f-fddd7dea9a8d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 21 13:41:09.472488 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-4f9975a9-41d3-46ce-9a8f-fddd7dea9a8d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:41:09.473036 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-4f9975a9-41d3-46ce-9a8f-fddd7dea9a8d admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057982 Jan 21 13:41:09.473548 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 19/39] 10.222.0.84 () {60 vars in 1190 bytes} [Fri Jan 21 13:41:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 13:41:09.482722 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-dab1c429-963e-47bd-90d4-9304e4e013ad admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:09.503492 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-dab1c429-963e-47bd-90d4-9304e4e013ad admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024140 Jan 21 13:41:09.504043 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 21/40] 10.222.0.84 () {60 vars in 1210 bytes} [Fri Jan 21 13:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:41:09.513394 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-8e5ddf91-8f3a-448c-ae90-888080446b28 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:09.533825 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-8e5ddf91-8f3a-448c-ae90-888080446b28 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023867 Jan 21 13:41:09.534907 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 20/41] 10.222.0.84 () {60 vars in 1210 bytes} [Fri Jan 21 13:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:41:09.543861 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-994ed548-5c53-4ae0-82d8-a2a408166db6 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:09.549261 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.wsgi [None req-994ed548-5c53-4ae0-82d8-a2a408166db6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 21 13:41:09.550464 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-994ed548-5c53-4ae0-82d8-a2a408166db6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:41:09.551251 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-994ed548-5c53-4ae0-82d8-a2a408166db6 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010836 Jan 21 13:41:09.551740 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 22/42] 10.222.0.84 () {60 vars in 1190 bytes} [Fri Jan 21 13:41:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 21 13:41:10.852464 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-8e5ddf91-8f3a-448c-ae90-888080446b28 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:10.853506 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-8e5ddf91-8f3a-448c-ae90-888080446b28 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jan 21 13:41:10.853909 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 21/43] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:11.050585 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-aa277b89-254e-4b43-a50a-52bc8c6ab912 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:11.055785 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.wsgi [None req-aa277b89-254e-4b43-a50a-52bc8c6ab912 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 21 13:41:11.056351 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-aa277b89-254e-4b43-a50a-52bc8c6ab912 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:41:11.057179 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-aa277b89-254e-4b43-a50a-52bc8c6ab912 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058995 Jan 21 13:41:11.057692 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 23/44] 10.222.0.84 () {60 vars in 1190 bytes} [Fri Jan 21 13:41:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 21 13:41:11.067221 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-530b403e-904d-4671-8b35-2f409223bbad admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:11.080250 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-530b403e-904d-4671-8b35-2f409223bbad admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017033 Jan 21 13:41:11.080885 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 22/45] 10.222.0.84 () {60 vars in 1210 bytes} [Fri Jan 21 13:41:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:41:11.090021 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-3aea934b-348d-43e3-91fb-66fa4242a1c4 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:11.103748 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-3aea934b-348d-43e3-91fb-66fa4242a1c4 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017099 Jan 21 13:41:11.104262 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 24/46] 10.222.0.84 () {60 vars in 1210 bytes} [Fri Jan 21 13:41:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:41:11.113715 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-23e06f60-0622-490f-a3d9-8a17aec41742 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:11.118866 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.wsgi [None req-23e06f60-0622-490f-a3d9-8a17aec41742 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 21 13:41:11.119420 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-23e06f60-0622-490f-a3d9-8a17aec41742 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:41:11.120190 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-23e06f60-0622-490f-a3d9-8a17aec41742 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010696 Jan 21 13:41:11.120704 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 23/47] 10.222.0.84 () {60 vars in 1190 bytes} [Fri Jan 21 13:41:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 21 13:41:12.399785 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-3aea934b-348d-43e3-91fb-66fa4242a1c4 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:12.400836 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-3aea934b-348d-43e3-91fb-66fa4242a1c4 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jan 21 13:41:12.401234 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 25/48] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:12.597052 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-3d6cd42f-8e2a-46e0-81ce-309c8ac914e7 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:12.602138 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.wsgi [None req-3d6cd42f-8e2a-46e0-81ce-309c8ac914e7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 21 13:41:12.602696 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-3d6cd42f-8e2a-46e0-81ce-309c8ac914e7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:41:12.603497 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-3d6cd42f-8e2a-46e0-81ce-309c8ac914e7 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057464 Jan 21 13:41:12.603991 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 24/49] 10.222.0.84 () {60 vars in 1193 bytes} [Fri Jan 21 13:41:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 13:41:12.613812 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-529600b5-2396-41fd-b445-b4b3b07080f4 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:12.627001 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-529600b5-2396-41fd-b445-b4b3b07080f4 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017353 Jan 21 13:41:12.627562 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 26/50] 10.222.0.84 () {60 vars in 1210 bytes} [Fri Jan 21 13:41:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:41:12.637263 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:12.649998 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016585 Jan 21 13:41:12.650511 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 25/51] 10.222.0.84 () {60 vars in 1210 bytes} [Fri Jan 21 13:41:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:41:12.660193 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-143db8a6-788c-4a34-8bb7-8739ee6e6bb9 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:12.665427 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.wsgi [None req-143db8a6-788c-4a34-8bb7-8739ee6e6bb9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 21 13:41:12.666001 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-143db8a6-788c-4a34-8bb7-8739ee6e6bb9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:41:12.666781 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-143db8a6-788c-4a34-8bb7-8739ee6e6bb9 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010592 Jan 21 13:41:12.667277 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 27/52] 10.222.0.84 () {60 vars in 1193 bytes} [Fri Jan 21 13:41:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 13:41:13.970134 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:13.971131 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 21 13:41:13.972185 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 26/53] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:14.168398 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-12089587-0790-4591-ba7e-e6e219b5ea16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:41:14.186998 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-12089587-0790-4591-ba7e-e6e219b5ea16 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070289 Jan 21 13:41:14.187539 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 28/54] 10.222.0.84 () {64 vars in 1235 bytes} [Fri Jan 21 13:41:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:41:15.477489 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:15.478488 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 Jan 21 13:41:15.478885 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 27/55] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:15.670890 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-8a8e2d5d-03d6-4774-8922-b93b3fa30a4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:41:15.688369 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-8a8e2d5d-03d6-4774-8922-b93b3fa30a4d admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069341 Jan 21 13:41:15.688857 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 29/56] 10.222.0.84 () {64 vars in 1235 bytes} [Fri Jan 21 13:41:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:41:16.979227 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:16.980224 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jan 21 13:41:16.980645 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 28/57] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:17.175767 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-12a46886-b4b0-4c5e-9a9f-b62421387490 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:41:17.193641 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-12a46886-b4b0-4c5e-9a9f-b62421387490 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069751 Jan 21 13:41:17.194176 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 30/58] 10.222.0.84 () {64 vars in 1235 bytes} [Fri Jan 21 13:41:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:41:18.482070 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:18.483068 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jan 21 13:41:18.483471 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 29/59] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:18.676401 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-9e6e2a7b-d75c-47bf-9148-f8648eee7ee3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:41:18.694001 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-9e6e2a7b-d75c-47bf-9148-f8648eee7ee3 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069195 Jan 21 13:41:18.694546 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 31/60] 10.222.0.84 () {64 vars in 1235 bytes} [Fri Jan 21 13:41:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:41:19.979286 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:19.980284 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 21 13:41:19.980717 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 30/61] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:41:20.180476 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-0b836782-2302-4599-a8fe-0a1685238b1e admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:41:20.199846 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-0b836782-2302-4599-a8fe-0a1685238b1e admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072806 Jan 21 13:41:20.200379 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 32/62] 10.222.0.84 () {60 vars in 1202 bytes} [Fri Jan 21 13:41:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:42:06.664252 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:42:06.665320 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-fe903c1c-0c04-4d2a-b00c-1b82a9904b53 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jan 21 13:42:06.665723 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 31/63] 10.222.0.84 () {54 vars in 930 bytes} [Fri Jan 21 13:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:42:06.722852 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-85568107-8313-434a-a61c-c8b6b8c93dbe admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:42:06.743698 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-85568107-8313-434a-a61c-c8b6b8c93dbe admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072258 Jan 21 13:42:06.744246 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 33/64] 10.222.0.84 () {60 vars in 1291 bytes} [Fri Jan 21 13:42:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:42:06.766162 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-181d8945-17a0-491a-9546-0005a3082195 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:42:06.774071 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-181d8945-17a0-491a-9546-0005a3082195 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011410 Jan 21 13:42:06.774585 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 32/65] 10.222.0.84 () {60 vars in 1282 bytes} [Fri Jan 21 13:42:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:42:06.786206 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-4bf4ab5b-ced4-47b3-ba6d-cd1ccde41157 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:42:06.793745 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-4bf4ab5b-ced4-47b3-ba6d-cd1ccde41157 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011533 Jan 21 13:42:06.794260 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 34/66] 10.222.0.84 () {60 vars in 1285 bytes} [Fri Jan 21 13:42:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:42:06.805806 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-5b58f882-f546-432d-b15c-56e2d2572e05 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:42:06.813327 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-5b58f882-f546-432d-b15c-56e2d2572e05 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010998 Jan 21 13:42:06.813845 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 33/67] 10.222.0.84 () {60 vars in 1285 bytes} [Fri Jan 21 13:42:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:42:06.825284 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:42:06.833302 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011500 Jan 21 13:42:06.833818 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 35/68] 10.222.0.84 () {60 vars in 1282 bytes} [Fri Jan 21 13:42:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:43:32.862473 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-88a62831-7013-45f7-a7da-619b4bbd8bec tempest-verify_tempest_config-1510965020 tempest-verify_tempest_config-1510965020-project] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:43:32.863838 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-88a62831-7013-45f7-a7da-619b4bbd8bec tempest-verify_tempest_config-1510965020 tempest-verify_tempest_config-1510965020-project] 10.222.0.84 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107949 Jan 21 13:43:32.864374 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 34/69] 10.222.0.84 () {58 vars in 1133 bytes} [Fri Jan 21 13:43:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:45:06.817875 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:06.818864 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jan 21 13:45:06.819253 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 36/70] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:45:07.075504 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-abd3bad3-cb45-41cf-a0d2-0033b66ad3bc admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:07.077222 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:45:07.077222 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: warnings.warn(msg) Jan 21 13:45:07.078809 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-abd3bad3-cb45-41cf-a0d2-0033b66ad3bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:07.079247 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-abd3bad3-cb45-41cf-a0d2-0033b66ad3bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:07.080042 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-abd3bad3-cb45-41cf-a0d2-0033b66ad3bc admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:07.080463 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-abd3bad3-cb45-41cf-a0d2-0033b66ad3bc admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:07.113039 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-abd3bad3-cb45-41cf-a0d2-0033b66ad3bc admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150133 Jan 21 13:45:07.113523 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 35/71] 10.222.0.84 () {60 vars in 1193 bytes} [Fri Jan 21 13:45:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:45:08.418878 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:08.419869 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jan 21 13:45:08.420264 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 37/72] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:45:08.619327 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-a6995254-d79d-48e3-bc3d-7735e58357cd admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:08.620501 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:45:08.620501 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: warnings.warn(msg) Jan 21 13:45:08.622116 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-a6995254-d79d-48e3-bc3d-7735e58357cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:08.622563 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-a6995254-d79d-48e3-bc3d-7735e58357cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:08.623364 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-a6995254-d79d-48e3-bc3d-7735e58357cd admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:08.624464 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-a6995254-d79d-48e3-bc3d-7735e58357cd admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:08.649358 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-a6995254-d79d-48e3-bc3d-7735e58357cd admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081157 Jan 21 13:45:08.649912 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 36/73] 10.222.0.84 () {60 vars in 1193 bytes} [Fri Jan 21 13:45:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:45:20.352494 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:20.353530 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 21 13:45:20.353926 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 38/74] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:45:20.547770 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-f083ac20-ed77-471a-8f1b-92e8c53f3c61 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:20.548976 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:45:20.548976 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: warnings.warn(msg) Jan 21 13:45:20.550489 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-f083ac20-ed77-471a-8f1b-92e8c53f3c61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:20.550940 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-f083ac20-ed77-471a-8f1b-92e8c53f3c61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:20.551867 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-f083ac20-ed77-471a-8f1b-92e8c53f3c61 admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:20.552418 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-f083ac20-ed77-471a-8f1b-92e8c53f3c61 admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:20.574562 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-f083ac20-ed77-471a-8f1b-92e8c53f3c61 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077815 Jan 21 13:45:20.575032 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 37/75] 10.222.0.84 () {60 vars in 1193 bytes} [Fri Jan 21 13:45:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:45:21.883636 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: DEBUG nova.api.openstack.wsgi [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] Calling method '>' {{(pid=108372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:21.884639 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: INFO nova.api.openstack.requestlog [None req-c30e3ab4-7548-42ea-8a6c-1ec56542dd56 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jan 21 13:45:21.885037 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: [pid: 108372|app: 0|req: 39/76] 10.222.0.84 () {56 vars in 1074 bytes} [Fri Jan 21 13:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:45:22.077034 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG nova.api.openstack.wsgi [None req-4a1ffd7b-a256-4097-9707-e72b3e01c4e7 admin admin] Calling method '>' {{(pid=108371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:45:22.078709 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:45:22.078709 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: warnings.warn(msg) Jan 21 13:45:22.080253 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-4a1ffd7b-a256-4097-9707-e72b3e01c4e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:22.080750 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-4a1ffd7b-a256-4097-9707-e72b3e01c4e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:22.081546 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-4a1ffd7b-a256-4097-9707-e72b3e01c4e7 admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:45:22.082000 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: DEBUG oslo_concurrency.lockutils [None req-4a1ffd7b-a256-4097-9707-e72b3e01c4e7 admin admin] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:45:22.102901 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: INFO nova.api.openstack.requestlog [None req-4a1ffd7b-a256-4097-9707-e72b3e01c4e7 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076357 Jan 21 13:45:22.103369 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: [pid: 108371|app: 0|req: 38/77] 10.222.0.84 () {60 vars in 1193 bytes} [Fri Jan 21 13:45:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:46:19.553169 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: Fri Jan 21 13:46:19 2022 - graceful shutdown triggered... Jan 21 13:46:19.553679 dv-cinder-820164-2-iscsi devstack@n-api.service[108371]: Gracefully killing worker 1 (pid: 108371)... Jan 21 13:46:19.553413 dv-cinder-820164-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 21 13:46:19.554477 dv-cinder-820164-2-iscsi devstack@n-api.service[108372]: Gracefully killing worker 2 (pid: 108372)... Jan 21 13:46:20.553393 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: worker 1 buried after 1 seconds Jan 21 13:46:20.553932 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: worker 2 buried after 1 seconds Jan 21 13:46:20.553932 dv-cinder-820164-2-iscsi devstack@n-api.service[108370]: goodbye to uWSGI. Jan 21 13:46:20.554993 dv-cinder-820164-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 21 13:46:20.555546 dv-cinder-820164-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 21 13:46:20.558369 dv-cinder-820164-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 21 13:46:20.568314 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 21 13:46:20.570908 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 21 13:46:20 2022] *** Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: nodename: dv-cinder-820164-2-iscsi Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: machine: x86_64 Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: clock source: unix Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: pcre jit disabled Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: detected number of CPU cores: 4 Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: current working directory: / Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: detected binary path: /usr/bin/uwsgi-core Jan 21 13:46:20.571073 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: your processes number limit is 47680 Jan 21 13:46:20.571721 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: your memory page size is 4096 bytes Jan 21 13:46:20.571721 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: detected max file descriptor number: 2048 Jan 21 13:46:20.571721 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: lock engine: pthread robust mutexes Jan 21 13:46:20.571721 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: thunder lock: enabled Jan 21 13:46:20.571721 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 21 13:46:20.571721 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 21 13:46:20.617765 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: Python main interpreter initialized at 0x5579c07529c0 Jan 21 13:46:20.617765 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: python threads support enabled Jan 21 13:46:20.617765 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: your server socket listen backlog is limited to 100 connections Jan 21 13:46:20.617765 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: your mercy for graceful operations on workers is 90 seconds Jan 21 13:46:20.618200 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: mapped 403077 bytes (393 KB) for 2 cores Jan 21 13:46:20.618200 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: *** Operational MODE: preforking *** Jan 21 13:46:20.618468 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: *** uWSGI is running in multiple interpreter mode *** Jan 21 13:46:20.618468 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: spawned uWSGI master process (pid: 122801) Jan 21 13:46:20.618677 dv-cinder-820164-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 21 13:46:20.619926 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: spawned uWSGI worker 1 (pid: 122813, cores: 1) Jan 21 13:46:20.619926 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: spawned uWSGI worker 2 (pid: 122814, cores: 1) Jan 21 13:46:20.619926 dv-cinder-820164-2-iscsi devstack@n-api.service[122801]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 21 13:46:22.589752 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:46:22.589752 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: from cryptography.utils import int_from_bytes Jan 21 13:46:22.590422 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:46:22.590422 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: from cryptography.utils import int_from_bytes Jan 21 13:46:22.625187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:46:22.625187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: from cryptography.utils import int_from_bytes Jan 21 13:46:22.626032 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 13:46:22.626032 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: from cryptography.utils import int_from_bytes Jan 21 13:46:25.037209 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 13:46:25.037793 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 13:46:25.037962 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 13:46:25.038325 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 13:46:25.038586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 13:46:25.038978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.039308 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.039633 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.039955 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.040285 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.040597 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.040940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.041262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.041591 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.041853 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.042171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.042495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820164-2-iscsi {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.042817 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.043124 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.043439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.043757 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.044066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.044386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.044720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.045220 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.045665 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.045986 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.046906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.047420 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.047746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.048060 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.048430 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.048770 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.049118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.049427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.049836 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820164-2-iscsi {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.050176 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.050476 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.050815 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.051217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.051534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.051849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.052173 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.052500 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.056207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.057612 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.058035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.058363 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.058689 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.059003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.059312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.059788 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.060111 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.060425 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.060762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.061077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.061391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.061747 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.062141 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.062477 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.062790 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.063115 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.063520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.063777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.064091 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.064437 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.064782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.065098 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.065423 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.065749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.066066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.066381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.066696 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.067022 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.067361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.067674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.067929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.068236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.068547 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.068897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.069211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.069524 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.069836 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.070139 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.070450 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.070763 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.071077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.071389 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.071700 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.072012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.072322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.072649 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.072962 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.073284 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.073608 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.073922 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.074234 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.074544 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.074855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.075178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.075491 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.075801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.076132 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.076444 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.076780 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.077103 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.078005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.078329 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.078655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.078963 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.079277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.079603 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.079915 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.080225 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.080534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.081410 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.081410 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.081642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.081773 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.082255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.082569 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.082894 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.083220 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.083537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.083848 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.084157 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.084482 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.084851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.085182 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.085714 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.086040 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.086377 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.086713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.087039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.087357 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.087677 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.088006 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.088324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.088667 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.088982 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.089306 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.089693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.089967 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.090288 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.090609 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.090952 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.091247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.091572 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.091905 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.092233 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.092549 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.092920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.093972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.094314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.094727 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.095050 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.095382 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.095705 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.096029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.096350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.096717 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.097039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.097359 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.097701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.098027 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.098349 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.098659 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.098968 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.099279 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.099596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.099910 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.100239 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.100393 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 13:46:25.100967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 13:46:25.101286 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.101286 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.101584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 13:46:25.101730 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.101875 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 13:46:25.102033 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.102190 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 13:46:25.102345 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.102516 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.102663 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.102822 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.102976 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.103129 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.103275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.103427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.103579 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.103739 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.104004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.104157 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.104319 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.104477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.104654 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.104654 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.104950 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.105102 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.105249 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.105394 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.105547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.105711 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.105926 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.106097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.106253 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820164-2-iscsi {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.106410 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.106583 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.106728 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.106873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.107016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.107169 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.107321 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.107549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.107697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.107842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.107993 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.108139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.108283 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.108438 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.108602 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.108785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.108949 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.109106 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.109262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.109408 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.109564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.109717 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.109878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.110097 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.110342 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.110508 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.110665 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.110811 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.110966 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.111272 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.111436 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.111590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.111744 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.111890 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.112041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.112196 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.112348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.112502 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820164-2-iscsi {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.112689 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.112850 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.113011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.113163 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.113315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.113315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.113596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.113750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.113952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.114216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.114367 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.114520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.114689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.114851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.114997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.115141 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.115293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.115446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.115592 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.115750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.115922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.116142 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.116301 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.116446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.116591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.116840 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.116991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.117152 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.117305 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.117458 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.117611 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.117772 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.117920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.118071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.118224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.118376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.118530 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.118675 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.118842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.118999 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.119151 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.119297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.119454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.119606 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.119752 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.119908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.120080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.120311 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.120539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.120756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.120924 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.121073 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.121243 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.121551 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.121698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.121844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.122004 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.122160 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.122314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.122458 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.122616 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.122761 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.122923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.123067 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.123221 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.123375 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.123534 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.123678 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.123823 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.123974 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.124127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.124453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.124679 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.125002 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.125167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.125378 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.125540 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.125687 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.125846 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.125992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.126157 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.126427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.126580 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.126735 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.126894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.127051 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.127197 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.127341 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.127505 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.127708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.127867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.128021 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.128176 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.128329 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.128483 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.128666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.128818 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.128963 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.129115 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.129267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.129426 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.129582 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.129727 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.129879 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.130030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.130176 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.130348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.130592 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.130812 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.130964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.131117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.131271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.131581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.131758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.131905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.132057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.132211 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.132358 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.132513 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.132687 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.132840 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.132987 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.133131 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.133275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.133434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.133580 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.133748 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.133905 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.134058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.134210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.134210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.134602 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.134755 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.134901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.135064 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.135750 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.135902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.136056 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.136220 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.136380 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.136656 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.136830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.136977 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.137130 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.137284 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.137430 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.137574 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.137734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.137882 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.138027 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.138248 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.138248 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.138570 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.138726 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.138872 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.139026 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.139172 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.139323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.139482 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.139635 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.139782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.140444 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.140929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.141098 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.141267 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.141420 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.141420 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.141866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.142024 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.142180 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.142336 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.142482 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.142634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.142794 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.142941 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.143093 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.143250 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.143425 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.143581 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.143734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.143888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.144040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.144194 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.144347 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.144501 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.144779 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.144935 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.145089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.145243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.145389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.145664 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.145829 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.145984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.146131 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.146284 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.146454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.146631 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.146859 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.147020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.147174 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.147328 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.147488 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.147488 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.147793 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.147941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.148085 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.148237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.148392 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.148537 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.148717 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.148986 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.149144 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.149350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.149509 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.149687 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 13:46:25.149863 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.150010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.150156 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.150314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.150461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.150606 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.150759 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.150923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.151218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.151218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.151513 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.151812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.151980 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.152149 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.152295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.152454 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.152602 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.152786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.152934 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.153087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.153233 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.153394 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.153540 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.153692 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.153837 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.153991 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.154150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.154302 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.154448 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.154600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.154766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.155010 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.155162 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.155306 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.155514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.156492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.156731 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.156975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.157147 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.157307 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.157459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.157626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.157788 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.157947 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.158099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.158251 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.158408 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.158573 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.158733 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.158887 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.159046 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.159208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.159366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.159532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.159693 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.159844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.159996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.160147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.160312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.160472 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.160644 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.160802 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.160956 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.161271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.161445 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.161609 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.161762 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.162071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.162223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.162374 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.162608 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.162771 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.162771 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.163215 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.163384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.163536 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.163712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.163872 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.164031 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.164184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.164334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.164492 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.164708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.164874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.165043 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.165288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.165455 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.165620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.165780 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.165942 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.166094 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.166253 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.166413 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.166579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.166747 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.166903 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.167140 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.167300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.167460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.167621 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.167774 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.167924 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.168094 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.168260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.168421 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.168582 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.168769 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.168923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.169081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.169234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.169399 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.169558 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.169710 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.169860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.170012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.170181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.170342 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.170503 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.170661 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.170813 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.170964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.171191 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.171473 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.171628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.171787 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.172093 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.172262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.172427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.172590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.172766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.172918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.173068 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.173246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.173246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.173636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.173789 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.173946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.174105 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.174265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.174426 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.174590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.174749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.174908 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.175066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.175218 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.175487 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.175657 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.175817 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.175978 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.176129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.176288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.176449 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.176601 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.176808 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.176962 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.177142 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.177379 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.177536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.177696 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.177855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.178008 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.178159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.178159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.178461 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.178612 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.178763 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.178925 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.179084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.179244 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.179403 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.179563 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.179714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.179872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.180024 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.180191 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.180343 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.180343 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.180660 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.180835 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.181000 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.181153 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.181304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.181557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.181725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.181725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.182172 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.182334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.182495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.182648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.182799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.182951 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.183126 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.183287 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.183465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.183698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.183867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.184028 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.184195 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.184348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.184499 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.184680 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.184839 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.185005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.185160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.185328 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.185497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.185744 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.185902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.186066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.186228 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.186380 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.186531 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.186719 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.186878 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.187038 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.187201 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.187379 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.187616 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.187782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.187934 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.188100 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.188254 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.188405 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.188556 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.188759 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.188912 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.189080 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.189234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.189385 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.189385 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.189684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.189849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.190001 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.190151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.190303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.190453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.190611 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.190776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.190936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.191087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.191238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.191397 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.191584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.191825 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.191983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.192161 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.192483 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.192679 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.192839 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.193000 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.193154 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.193314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.193474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.193626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.193952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.194124 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.194276 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.194435 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.194589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.194749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.194915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.194915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.195211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.198219 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.198402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.198562 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.198731 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.198888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.199071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.199234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.199387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.199540 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.199701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.199701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.200008 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.200008 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.200305 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.200475 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.200648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.200819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.200972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.201133 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.201285 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.201451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.201610 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.201762 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.202012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.202180 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.203014 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.203188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.203342 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.203494 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.203645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.203808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.204059 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.204233 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.204386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.204537 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.204750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.204916 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.205079 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.205289 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.205450 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.205611 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.205763 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.205914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.206087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.206241 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.206392 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.206628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.206791 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.207064 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.207237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.207397 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.207557 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.207718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.207870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.208021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.208270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.208442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.208601 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.208777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.208941 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.209108 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.209275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.209429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.209587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.209746 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.209905 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.210066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.210219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.210377 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.210541 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.210700 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.210860 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.211023 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.211181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.211335 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.211487 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.211638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.211796 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.211960 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.212277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.212446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.212635 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.212795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.212984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.213296 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.213459 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.213611 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.213763 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.213915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.214098 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.214334 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.214493 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.214644 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.214795 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.214958 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.214958 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.215270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.215422 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.215575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.215735 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.215896 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.216058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.216217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.216369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.216521 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.216712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.217154 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.217340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.217502 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.217502 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.217793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.217987 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.218441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.218610 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.218771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.218924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.219075 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.219235 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.219400 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.219560 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.219732 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.219885 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.220037 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.220195 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.220356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.220508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.220679 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.220849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.221010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.221171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.221331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.221490 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.221659 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.221814 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.221964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.222128 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.222383 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.222549 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.222549 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.222855 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.223015 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.223350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.223510 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.223662 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.223821 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.224052 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.224214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.224490 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.224490 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.224843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.224843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.225135 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.225298 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.225478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.225478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.225925 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.226096 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.226249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.226422 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.226575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.226743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.226897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.226897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.227227 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.227475 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.227633 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.227821 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.228048 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.228212 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.228392 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.228634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.228808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.228972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.229139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.229293 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.229444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.229602 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.229762 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.229975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.230140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.230300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.230453 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.230605 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.230768 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.230928 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.231094 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.231253 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.231406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.231557 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.231708 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.231872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.232032 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.232192 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.232363 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.232593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.232773 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.232948 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.233101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.233253 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.234080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.234247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.234401 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.234655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.234824 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.234984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.235264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.235446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.235609 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.235776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.235939 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.236090 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.236308 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.236470 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.236694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.236855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.237006 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.237167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.237330 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.237502 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.237762 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.237929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.238090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.238332 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.238504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.238748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.238917 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.239069 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.239229 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.239388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.239552 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.239715 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.239876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.240035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.240187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.240187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.240495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.240680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.240872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.241029 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.241181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.241332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.241483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.241643 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.241797 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.241962 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.242120 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.242280 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.242442 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.242622 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.242865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.243023 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.243182 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.243342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.243655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.243835 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.243990 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244462 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244570 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244699 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244781 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244854 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.244924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245008 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245194 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245525 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245606 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245686 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245915 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.245996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246069 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246147 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246226 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246308 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246389 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246468 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246545 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246618 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246696 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246778 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246857 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.246937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247085 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247169 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247253 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247253 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247390 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247463 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247533 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247603 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.247936 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248032 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248112 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248332 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248415 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248487 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248739 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248828 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248909 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.248982 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.249053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.249053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.249207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.249319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.249897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.249971 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250111 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250180 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250259 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250672 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250912 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.250983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251060 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251132 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251359 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251498 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251567 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251646 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251717 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.251937 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252321 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252393 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252475 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.252975 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253059 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253287 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253839 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.253946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254110 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254190 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254415 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254485 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254625 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254625 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254761 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254831 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.254970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255117 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255266 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255484 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255565 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255651 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.255957 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256038 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256111 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256258 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256330 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256330 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256485 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256565 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256677 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256852 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.256948 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257228 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257405 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257505 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257769 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.257878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258333 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258418 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258509 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258595 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258779 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.258870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259036 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259123 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259123 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259296 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259390 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259476 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259560 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259560 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.259985 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.260070 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.260153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.260245 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.260439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.260644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.260816 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.261071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.261178 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.261479 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.261773 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.261866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.262124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.262316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.262455 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.262815 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.262922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.263102 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.263237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.263440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.263694 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.264009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.264117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.264211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.264392 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.264560 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.264776 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.265041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.265273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.265478 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.265602 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.265899 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.265995 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.266314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.266416 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.266678 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.266812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.267004 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.267191 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.267341 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.267612 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.267703 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.267985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.268278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.268441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.268532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.268734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.268979 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.269164 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.269299 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.269634 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.269738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.269952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.270233 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.270336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.270588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.270832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.270994 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.271294 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.271481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.271612 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.271946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.272047 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.272265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.272575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.272711 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.272941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.273206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.273308 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.273600 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.273795 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.273922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.274805 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.274902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.274997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.275104 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.275205 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.275205 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.275373 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.275466 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.275792 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.275936 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.276109 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.276442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.276543 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.276834 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.277065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.277169 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.277487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.277648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.277834 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.278149 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.278256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.278512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.278804 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.278930 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.279138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.279445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.279547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.279758 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.280044 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.280138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.280384 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.280717 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.280828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.281149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.281727 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.281828 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.282042 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.282350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.282442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.282663 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.282947 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.283053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.283301 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.283533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.283628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.283944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.284136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.284260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.284577 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.284918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.285022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.285247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.285359 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.285595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.285861 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.285961 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.286257 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.286458 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.286590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.286929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.287076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.287250 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.287578 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.287686 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.287904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.288159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.288261 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.288600 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.288746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.288899 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.289226 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.289326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.289552 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.289838 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.289941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.290184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.290443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.290536 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.290821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.291024 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.291149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.291537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.291727 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.292059 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.292160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.292381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.292976 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.293102 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.293199 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.293309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.293398 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.293701 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.293805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.294022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.294303 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.294397 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.294653 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.294997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.295105 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.295302 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.295471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.295633 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.295967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.296580 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.296876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.297213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.297309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.297631 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.297805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.297964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.298297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.298389 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.298734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.298859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.298991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.299309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.299402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.299638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.299914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.300022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.300277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.300524 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.300638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.300958 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.301136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.301289 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.301619 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.301719 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.301945 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.302217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.302324 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.302579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.302822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.303167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.303270 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.303400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.303561 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.303903 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.304008 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.304227 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.304481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.304576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.304899 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.305751 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.305751 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.305938 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.305938 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.306094 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.306179 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.306394 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.306671 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.306775 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.307178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.307300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.307640 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.307749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.307982 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.308272 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.308374 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.308639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.308914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.309040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.309288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.309497 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.309597 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.309926 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.310088 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.310250 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.310581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.310682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.310896 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.311214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.311315 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.311744 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.312589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.312855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.313312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.313434 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.313535 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.313706 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.313951 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.314057 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.314367 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.314536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.314691 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.315030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.315368 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.315483 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.315573 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 13:46:25.315666 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.315974 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.316297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.316635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.317084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.317302 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.317623 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.317940 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.318266 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.318585 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.318941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.319251 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.319702 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.320023 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.320352 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.320699 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.321019 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.321337 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.321657 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.321978 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.322293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.322617 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.322935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.323259 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.323581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.323904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.324219 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.324555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.324914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.325232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.325570 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.325894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.326230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.326557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.326882 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.327243 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.327793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.328442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.328867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.329206 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.329563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.329932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.330236 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.330557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.330877 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.331213 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.331538 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.331865 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.332188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.332512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.332873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.333199 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.333636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.333888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.334164 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.334484 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.334810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.335167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.335501 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.335834 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.336162 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.336493 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.337783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.337783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.337783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.337783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.338589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.338589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.338972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.339162 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.339455 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.339782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.340113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.340451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.340808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.341143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.341476 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.341709 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_db.sqlalchemy.engines [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.341810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.342125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.342436 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.342797 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.344351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.344351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.344351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.344351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.345035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.345035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.345348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.345512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.345721 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.346050 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.346452 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.346700 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.347030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.347350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.347686 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.348650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.348650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.348860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.349022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.349381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.349666 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.349988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.350309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.350629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.350951 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.351292 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.351630 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.351946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.352280 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.352627 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.352961 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.353291 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.353622 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.353985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.354272 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.354597 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.354920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.355239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.355568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.355895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.356231 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.356565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.356925 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.357258 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.357616 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.357941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.358302 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.359161 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.359483 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.359805 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.360120 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 13:46:25.360373 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 13:46:25.383705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.406920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.context [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),015249c4-915d-4c7c-ba7f-761b11b5af70(cell1) {{(pid=122813) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 13:46:25.411246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:46:25.412849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:46:25.413662 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:46:25.415590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:46:25.426928 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_db.sqlalchemy.engines [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.427759 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_db.sqlalchemy.engines [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.447937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.context [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),015249c4-915d-4c7c-ba7f-761b11b5af70(cell1) {{(pid=122814) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 13:46:25.452260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:46:25.454026 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:46:25.454855 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:46:25.456845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:46:25.467644 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.469032 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.585686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_db.sqlalchemy.engines [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.628800 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 13:46:25.912864 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: WARNING keystonemiddleware.auth_token [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:46:25.919506 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: WARNING keystonemiddleware.auth_token [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:46:25.980741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:46:25.987901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:46:26.262903 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: WARNING keystonemiddleware.auth_token [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:46:26.268307 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: WARNING keystonemiddleware.auth_token [None req-4af0b0b2-39fb-4f14-aa12-487d7dd64980 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:46:26.273439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579c07529c0 pid: 122813 (default app) Jan 21 13:46:26.336574 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 13:46:26.342070 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-8317d402-7124-447f-aa93-b3d77ff79a16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 13:46:26.347947 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579c07529c0 pid: 122814 (default app) Jan 21 13:47:01.602463 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-70b18be2-89c6-41d1-85dd-34862bbe825a tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Action: 'create', calling method: .version_select at 0x7f51bccf5550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1433819099", "metadata": {"Type": "work"}}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:01.656331 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cd97a9d8-ba43-426c-ac48-17f79bc484e6 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Action: 'create', calling method: .version_select at 0x7f51bccf5550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-172316300", "metadata": {"Type": "work"}}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:01.658383 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cd97a9d8-ba43-426c-ac48-17f79bc484e6 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:01.659344 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-cd97a9d8-ba43-426c-ac48-17f79bc484e6 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.363030 Jan 21 13:47:01.659909 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 1/1] 10.222.0.84 () {60 vars in 1155 bytes} [Fri Jan 21 13:47:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:47:01.790068 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-caa1d31e-3045-45d1-9d51-c6451693882f tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Action: 'create', calling method: .version_select at 0x7f51bcc21160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1925234332"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:02.775884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-70b18be2-89c6-41d1-85dd-34862bbe825a tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.203241 Jan 21 13:47:02.777996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 1/2] 10.222.0.84 () {60 vars in 1155 bytes} [Fri Jan 21 13:47:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2207 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 21 13:47:02.888137 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-caa1d31e-3045-45d1-9d51-c6451693882f tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.226914 Jan 21 13:47:02.897100 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 2/3] 10.222.0.84 () {60 vars in 1154 bytes} [Fri Jan 21 13:47:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1230 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 21 13:47:02.902663 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8349cb7e-bcf5-4ea2-9df3-4e20ebc4db9a tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Action: 'create', calling method: .version_select at 0x7f51bccf5ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1028023042", "metadata": {"Type": "work"}}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:02.904709 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8349cb7e-bcf5-4ea2-9df3-4e20ebc4db9a tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:02.907855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8349cb7e-bcf5-4ea2-9df3-4e20ebc4db9a tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015778 Jan 21 13:47:02.908404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 3/4] 10.222.0.84 () {60 vars in 1155 bytes} [Fri Jan 21 13:47:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:47:02.955345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-66877284", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "c435b6fc-b642-4606-8c76-2349a600bf75"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:03.021596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-409357550", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "d3bfe002-b112-41ad-8d5b-fc9e48025c33"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:03.102072 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] validate_networks() for [('c435b6fc-b642-4606-8c76-2349a600bf75', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:47:03.208558 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] validate_networks() for [('d3bfe002-b112-41ad-8d5b-fc9e48025c33', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:47:04.294091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:47:04.296107 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:47:04.297806 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:47:04.298831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:47:04.304140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:47:04.353745 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:04.365394 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:04.367832 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:04.369969 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:04.442472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Getting quotas for project 309a292210bd4c6b8f0f6d20524b6cec. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:04.458434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Getting quotas for user 2448194319f54b5ebb927da1b0910ce1 and project 309a292210bd4c6b8f0f6d20524b6cec. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:04.474545 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:47:04.478195 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:47:04.602911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e26636c4-cfe7-4c19-abae-bc55b1c92deb tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823462 Jan 21 13:47:04.604044 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 2/5] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:47:04.610922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0228383e-3c9d-4f85-bb3a-8d6f06441cf4 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Calling method '.version_select at 0x7f51bcaccdc0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:04.670322 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0228383e-3c9d-4f85-bb3a-8d6f06441cf4 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45" status: 200 len: 354 microversion: 2.1 time: 0.063871 Jan 21 13:47:04.671520 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 3/6] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:04 2022] GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:04.677847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-936f8d6f-4146-44b8-86a0-71a3adaf3fa5 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bcad6a60>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:04.804522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-936f8d6f-4146-44b8-86a0-71a3adaf3fa5 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2" status: 200 len: 346 microversion: 2.1 time: 0.089686 Jan 21 13:47:04.804522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 4/7] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:04 2022] GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2 => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:04.804522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-68e565da-eb1e-4588-92f9-e13092b43ac9 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Action: 'create', calling method: .version_select at 0x7f51bcad6ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1240515503", "metadata": {"Type": "work"}}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:04.804522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-68e565da-eb1e-4588-92f9-e13092b43ac9 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:04.804522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-68e565da-eb1e-4588-92f9-e13092b43ac9 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019578 Jan 21 13:47:04.805432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 5/8] 10.222.0.84 () {60 vars in 1155 bytes} [Fri Jan 21 13:47:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:47:04.805432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cd5e96de-e50c-42b6-b79c-0a17caf3ac42 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:04.811399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cd5e96de-e50c-42b6-b79c-0a17caf3ac42 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:05.022629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cd5e96de-e50c-42b6-b79c-0a17caf3ac42 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:05.048256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cd5e96de-e50c-42b6-b79c-0a17caf3ac42 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1213 microversion: 2.1 time: 0.260479 Jan 21 13:47:05.052907 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 6/9] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:04 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:05.058646 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c2ff6da1-77d2-4247-b0c8-df97c68fe392 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Calling method '.version_select at 0x7f51bcad6af0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.145150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c2ff6da1-77d2-4247-b0c8-df97c68fe392 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45" status: 200 len: 354 microversion: 2.1 time: 0.090823 Jan 21 13:47:05.145920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 7/10] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:05.150998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f705ab27-3ffd-454b-a001-801d806769c4 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Action: 'create', calling method: .version_select at 0x7f51bc286ca0>, body: {"snapshot": {"volume_id": "567327b0-9f76-4677-a583-56f5174c9aa2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1660918193"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:05.176599 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:47:05.177113 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:47:05.177533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:47:05.177948 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:47:05.178361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:47:05.200757 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:05.201369 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:05.202248 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:05.202643 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:05.239480 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:05.246343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for user 8ef601f05ed04634bf325e21efbea29d and project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:05.259229 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:47:05.262585 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:47:05.350388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-424e132e-5630-452a-8ad6-2146a1e0898e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.435444 Jan 21 13:47:05.356637 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 4/11] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:47:05.363154 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a787ab6b-f667-4465-8100-32bf6e72e049 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Calling method '.version_select at 0x7f51bcad1e50>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.402034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-a787ab6b-f667-4465-8100-32bf6e72e049 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] HTTP exception thrown: Volume tempest-invalid-787738583 could not be found. Jan 21 13:47:05.403611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a787ab6b-f667-4465-8100-32bf6e72e049 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Returning 404 to user: Volume tempest-invalid-787738583 could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:05.405898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a787ab6b-f667-4465-8100-32bf6e72e049 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/tempest-invalid-787738583" status: 404 len: 98 microversion: 2.1 time: 0.047674 Jan 21 13:47:05.406992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 5/12] 10.222.0.84 () {58 vars in 1214 bytes} [Fri Jan 21 13:47:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-787738583 => generated 98 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 21 13:47:05.428014 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-392d8e5f-6c16-4593-b7d2-7df0cc317030 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Calling method '.version_select at 0x7f51bcade3a0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.552201 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f705ab27-3ffd-454b-a001-801d806769c4 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.404832 Jan 21 13:47:05.553319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 8/13] 10.222.0.84 () {60 vars in 1161 bytes} [Fri Jan 21 13:47:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:05.559163 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-87a5b0b3-a4d3-441b-b35b-23cfefaaf426 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.560027 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-87a5b0b3-a4d3-441b-b35b-23cfefaaf426 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:05.657067 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-392d8e5f-6c16-4593-b7d2-7df0cc317030 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45" status: 202 len: 0 microversion: 2.1 time: 0.243023 Jan 21 13:47:05.657920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 6/14] 10.222.0.84 () {58 vars in 1247 bytes} [Fri Jan 21 13:47:05 2022] DELETE /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:47:05.664870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c344672b-9d88-4ab7-9958-5aa2e35e150d tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005544 Jan 21 13:47:05.666117 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 7/15] 10.222.0.84 () {58 vars in 1139 bytes} [Fri Jan 21 13:47:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 21 13:47:05.676907 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-88165093-3ef6-46de-8e1a-43606f518392 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bcadec10>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.732017 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-87a5b0b3-a4d3-441b-b35b-23cfefaaf426 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:05.741919 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-87a5b0b3-a4d3-441b-b35b-23cfefaaf426 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1217 microversion: 2.1 time: 0.187129 Jan 21 13:47:05.746127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 9/16] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:05.757589 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-88165093-3ef6-46de-8e1a-43606f518392 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 200 len: 287 microversion: 2.1 time: 0.090269 Jan 21 13:47:05.762303 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 8/17] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:05.767088 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7cebf256-86cb-4f59-ac67-0b525472b910 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Calling method '.version_select at 0x7f51bcad6a60>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.772595 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5935f91d-92fc-472b-8edc-3568e7d92c94 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007863 Jan 21 13:47:05.773706 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 9/18] 10.222.0.84 () {58 vars in 1136 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 21 13:47:05.782153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ddf7a358-1d09-4682-8d01-b81557ef5772 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bcade550>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.885617 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7cebf256-86cb-4f59-ac67-0b525472b910 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45" status: 200 len: 353 microversion: 2.1 time: 0.137890 Jan 21 13:47:05.886312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 10/19] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45 => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:05.895341 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d701f994-3f12-4311-8e5b-fa0ffcd072bc tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Calling method '.version_select at 0x7f51bc28f8b0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.898261 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ddf7a358-1d09-4682-8d01-b81557ef5772 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.123148 Jan 21 13:47:05.898902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 10/20] 10.222.0.84 () {58 vars in 1139 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:05.909306 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5c5095e6-fc99-4499-ac6e-382e1323567c tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bcade790>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:05.965002 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-d701f994-3f12-4311-8e5b-fa0ffcd072bc tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] HTTP exception thrown: Volume a4597268-99b6-4272-affe-cad6859048a6 could not be found. Jan 21 13:47:05.966138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d701f994-3f12-4311-8e5b-fa0ffcd072bc tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Returning 404 to user: Volume a4597268-99b6-4272-affe-cad6859048a6 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:05.967229 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d701f994-3f12-4311-8e5b-fa0ffcd072bc tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/a4597268-99b6-4272-affe-cad6859048a6" status: 404 len: 109 microversion: 2.1 time: 0.079613 Jan 21 13:47:05.967881 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 11/21] 10.222.0.84 () {58 vars in 1247 bytes} [Fri Jan 21 13:47:05 2022] DELETE /compute/v2.1/os-volumes/a4597268-99b6-4272-affe-cad6859048a6 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:47:05.977926 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5c5095e6-fc99-4499-ac6e-382e1323567c tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 200 len: 287 microversion: 2.1 time: 0.072328 Jan 21 13:47:05.982313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 11/22] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:47:05.982493 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f92416da-bcfd-4cd6-8c1f-2c2da2ca0290 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Calling method '.version_select at 0x7f51bcad6430>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:06.035352 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-f92416da-bcfd-4cd6-8c1f-2c2da2ca0290 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] HTTP exception thrown: Volume 5ba76f27-2355-458e-b9e3-54eaa3436728 could not be found. Jan 21 13:47:06.036245 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f92416da-bcfd-4cd6-8c1f-2c2da2ca0290 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] Returning 404 to user: Volume 5ba76f27-2355-458e-b9e3-54eaa3436728 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:06.037549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f92416da-bcfd-4cd6-8c1f-2c2da2ca0290 tempest-VolumesNegativeTest-873869528 tempest-VolumesNegativeTest-873869528-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/5ba76f27-2355-458e-b9e3-54eaa3436728" status: 404 len: 109 microversion: 2.1 time: 0.063917 Jan 21 13:47:06.039692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 12/23] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:05 2022] GET /compute/v2.1/os-volumes/5ba76f27-2355-458e-b9e3-54eaa3436728 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:47:06.069995 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-77d5319a-0eac-4cdb-baca-d7efef137930 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:06.071289 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-77d5319a-0eac-4cdb-baca-d7efef137930 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:06.339857 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-77d5319a-0eac-4cdb-baca-d7efef137930 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:06.364837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-77d5319a-0eac-4cdb-baca-d7efef137930 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1213 microversion: 2.1 time: 0.300729 Jan 21 13:47:06.366010 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 12/24] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:06 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:06.766344 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:06.767035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:06.786466 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:06.786929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:06.799785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:06.800278 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:06.899278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-78d485d4-e7ba-4ada-9b13-164d3ec0c4ee tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Calling method '.version_select at 0x7f51bcade550>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:07.015169 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-78d485d4-e7ba-4ada-9b13-164d3ec0c4ee tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45" status: 200 len: 353 microversion: 2.1 time: 0.118550 Jan 21 13:47:07.016637 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 13/25] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:06 2022] GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:07.022077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d76c8fb9-de4e-435a-8338-330920d1bfab tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc290820>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:07.142716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d76c8fb9-de4e-435a-8338-330920d1bfab tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 200 len: 287 microversion: 2.1 time: 0.124875 Jan 21 13:47:07.143878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 14/26] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:47:07 2022] GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:07.237825 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:07.262682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-59747ba0-6fec-43e7-8a36-6eebc8a87bcd tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1221 microversion: 2.1 time: 0.500802 Jan 21 13:47:07.279935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 13/27] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:06 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1221 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:07.382870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:07.383491 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:07.397491 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:07.397948 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:07.398771 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:07.406727 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:07.776746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:07.806026 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c972337e-c0a0-4f6d-a9c6-92a404b4c0a6 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1217 microversion: 2.1 time: 0.427784 Jan 21 13:47:07.806718 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 15/28] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:07 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1217 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:08.028155 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6b54f796-3a5d-42ed-a752-c182827ac0d1 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Calling method '.version_select at 0x7f51bc207b80>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:08.106474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6b54f796-3a5d-42ed-a752-c182827ac0d1 tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45" status: 200 len: 353 microversion: 2.1 time: 0.082940 Jan 21 13:47:08.107994 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 14/29] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:08 2022] GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:08.160093 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9dfe4114-adf2-4103-b293-787c970a83d8 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bcade430>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:08.214086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9dfe4114-adf2-4103-b293-787c970a83d8 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 200 len: 287 microversion: 2.1 time: 0.060288 Jan 21 13:47:08.215298 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 16/30] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:47:08 2022] GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:08.283111 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:08.283981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:08.302094 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:08.302695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:08.303579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:08.304110 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:08.809535 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:08.824048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:08.825573 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:08.844052 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-846d8d65-647e-4dfa-ac39-be967a8aa7fc tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1221 microversion: 2.1 time: 0.565406 Jan 21 13:47:08.859275 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 15/31] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:08 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1221 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:08.860309 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:08.861834 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:08.863214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:08.863822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:09.119908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:09.120188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d9a889da-ab9d-4281-a999-dd90c286661f tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Calling method '.version_select at 0x7f51bc2155e0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:09.129037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9fe3580f-3589-494f-ad1e-6da53ce51059 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1217 microversion: 2.1 time: 0.308773 Jan 21 13:47:09.179258 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 17/32] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:08 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1217 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:09.214293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-d9a889da-ab9d-4281-a999-dd90c286661f tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] HTTP exception thrown: Volume 74d62b3c-2835-4f95-a46a-d5e3f2993e45 could not be found. Jan 21 13:47:09.215112 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d9a889da-ab9d-4281-a999-dd90c286661f tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] Returning 404 to user: Volume 74d62b3c-2835-4f95-a46a-d5e3f2993e45 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:09.216067 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d9a889da-ab9d-4281-a999-dd90c286661f tempest-VolumesGetTestJSON-807377762 tempest-VolumesGetTestJSON-807377762-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45" status: 404 len: 109 microversion: 2.1 time: 0.100396 Jan 21 13:47:09.218693 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 16/33] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:09 2022] GET /compute/v2.1/os-volumes/74d62b3c-2835-4f95-a46a-d5e3f2993e45 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:47:09.225971 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cec61b7c-3838-405b-99e3-effa30abd2c8 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc290af0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:09.285236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-cec61b7c-3838-405b-99e3-effa30abd2c8 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 200 len: 288 microversion: 2.1 time: 0.063223 Jan 21 13:47:09.291885 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 18/34] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:47:09 2022] GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 288 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:09.300230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-21f3229f-5a11-4ddc-b1ef-78df8d4a8226 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc1ae790>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:09.463078 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-21f3229f-5a11-4ddc-b1ef-78df8d4a8226 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "DELETE /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 202 len: 0 microversion: 2.1 time: 0.170459 Jan 21 13:47:09.463706 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 17/35] 10.222.0.84 () {58 vars in 1253 bytes} [Fri Jan 21 13:47:09 2022] DELETE /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:47:09.473511 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5d1dcc3c-3d71-4d29-877f-5d0447b2f318 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc2125e0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:09.538121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5d1dcc3c-3d71-4d29-877f-5d0447b2f318 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 200 len: 287 microversion: 2.1 time: 0.069006 Jan 21 13:47:09.539366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 19/36] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:47:09 2022] GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:09.877578 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:09.878504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:09.927152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:09.927152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:09.927742 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:09.932967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:10.207324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:10.209598 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:10.228319 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:10.231005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:10.233579 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:10.236638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:10.323841 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:10.335687 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f016b0c6-290b-469f-bd4f-ed19c97b0c59 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1277 microversion: 2.1 time: 0.464125 Jan 21 13:47:10.336477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 18/37] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:09 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1277 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:10.553421 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f75e535f-a98f-417e-b058-1443d847334e tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc1b6310>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:10.612022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-f75e535f-a98f-417e-b058-1443d847334e tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] HTTP exception thrown: Snapshot 55f851ee-7aa9-40d3-aa4f-584baa78b6f2 could not be found. Jan 21 13:47:10.613303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f75e535f-a98f-417e-b058-1443d847334e tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Returning 404 to user: Snapshot 55f851ee-7aa9-40d3-aa4f-584baa78b6f2 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:10.614868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f75e535f-a98f-417e-b058-1443d847334e tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2" status: 404 len: 111 microversion: 2.1 time: 0.067183 Jan 21 13:47:10.615868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 19/38] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:47:10 2022] GET /compute/v2.1/os-snapshots/55f851ee-7aa9-40d3-aa4f-584baa78b6f2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:47:10.627810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7667f377-9a42-411f-844a-384ae538ddf5 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc160700>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:10.731081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:10.741139 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1a161652-4eec-43ab-ae80-34d2c755ca77 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1283 microversion: 2.1 time: 0.545385 Jan 21 13:47:10.744783 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 20/39] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:10 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1283 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:10.811636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7667f377-9a42-411f-844a-384ae538ddf5 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2" status: 202 len: 0 microversion: 2.1 time: 0.190783 Jan 21 13:47:10.812701 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 20/40] 10.222.0.84 () {58 vars in 1247 bytes} [Fri Jan 21 13:47:10 2022] DELETE /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:47:10.821036 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0951c473-0219-4217-ab02-c6fe6c905510 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc212af0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:10.928391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0951c473-0219-4217-ab02-c6fe6c905510 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2" status: 200 len: 345 microversion: 2.1 time: 0.111172 Jan 21 13:47:10.930331 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 21/41] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:10 2022] GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:11.354688 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:11.355378 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:11.367983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:11.369573 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:11.371486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:11.373596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:11.620522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:11.635477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ab009b8a-8ac3-4c31-8837-aa3a1823e029 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1275 microversion: 2.1 time: 0.285155 Jan 21 13:47:11.640527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 21/42] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:11 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1275 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:11.760674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:11.761863 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:11.779765 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:11.781180 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:11.782463 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:11.783081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:11.943615 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e71b2db5-9cb1-4fed-9443-e5137bc5ccc3 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc160820>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:12.006826 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-e71b2db5-9cb1-4fed-9443-e5137bc5ccc3 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] HTTP exception thrown: Volume 567327b0-9f76-4677-a583-56f5174c9aa2 could not be found. Jan 21 13:47:12.007739 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e71b2db5-9cb1-4fed-9443-e5137bc5ccc3 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Returning 404 to user: Volume 567327b0-9f76-4677-a583-56f5174c9aa2 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:12.008756 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e71b2db5-9cb1-4fed-9443-e5137bc5ccc3 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2" status: 404 len: 109 microversion: 2.1 time: 0.069226 Jan 21 13:47:12.009931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 22/43] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:11 2022] GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:47:12.025533 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b2e665b-5a50-4173-82a2-47ca7bcc70dd tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc1c39d0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:12.149380 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-1b2e665b-5a50-4173-82a2-47ca7bcc70dd tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] HTTP exception thrown: Volume 567327b0-9f76-4677-a583-56f5174c9aa2 could not be found. Jan 21 13:47:12.153529 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b2e665b-5a50-4173-82a2-47ca7bcc70dd tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Returning 404 to user: Volume 567327b0-9f76-4677-a583-56f5174c9aa2 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:12.155496 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b2e665b-5a50-4173-82a2-47ca7bcc70dd tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2" status: 404 len: 109 microversion: 2.1 time: 0.134478 Jan 21 13:47:12.156880 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 23/44] 10.222.0.84 () {58 vars in 1247 bytes} [Fri Jan 21 13:47:12 2022] DELETE /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:47:12.166677 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-183da5a8-5b25-4bbb-a4c9-09a0c2977a98 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Calling method '.version_select at 0x7f51bc160550>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:12.283785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-183da5a8-5b25-4bbb-a4c9-09a0c2977a98 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] HTTP exception thrown: Volume 567327b0-9f76-4677-a583-56f5174c9aa2 could not be found. Jan 21 13:47:12.284817 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-183da5a8-5b25-4bbb-a4c9-09a0c2977a98 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] Returning 404 to user: Volume 567327b0-9f76-4677-a583-56f5174c9aa2 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:12.286348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-183da5a8-5b25-4bbb-a4c9-09a0c2977a98 tempest-VolumesSnapshotsTestJSON-1177990137 tempest-VolumesSnapshotsTestJSON-1177990137-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2" status: 404 len: 109 microversion: 2.1 time: 0.125468 Jan 21 13:47:12.287338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 24/45] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:47:12 2022] GET /compute/v2.1/os-volumes/567327b0-9f76-4677-a583-56f5174c9aa2 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:47:12.399036 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:12.416411 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-78de1e11-74a5-41bf-acd5-4f1cd001b094 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1271 microversion: 2.1 time: 0.659441 Jan 21 13:47:12.423627 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 22/46] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:11 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1271 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:12.606693 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1854909702", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:12.661450 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:12.662249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:12.706338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:12.708337 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:12.710927 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:12.715493 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:12.769611 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] validate_networks() for [('8def9da6-8338-4654-a529-ca0ba4b105e0', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:47:14.164742 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:47:14.166890 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:47:14.167642 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:47:14.168299 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:47:14.168977 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:47:14.183095 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:14.183993 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:14.191954 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:14.194230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:14.271641 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Getting quotas for project 129b530f15584103a5bf73d0a63e801d. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:14.276391 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Getting quotas for user 8122bf15cfa8466db22e7046a22c1345 and project 129b530f15584103a5bf73d0a63e801d. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:14.306712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:47:14.315204 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:47:14.451631 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-23124f00-9306-4fe5-85d9-0523d9fa7d5a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.156701 Jan 21 13:47:14.460532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 25/47] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:47:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:47:14.472215 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:14.492531 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:14.545361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:14.546093 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:14.547614 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:14.551596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:15.154718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:15.167422 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8f6fe47b-4355-485d-bd3d-e1725055eb2f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1271 microversion: 2.1 time: 0.703542 Jan 21 13:47:15.174001 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 26/48] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:14 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1271 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:15.183200 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fef76e96-9a28-4949-946d-3541255158ad tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:15.183821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fef76e96-9a28-4949-946d-3541255158ad tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:15.423575 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fef76e96-9a28-4949-946d-3541255158ad tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:15.440066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fef76e96-9a28-4949-946d-3541255158ad tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1222 microversion: 2.1 time: 0.264419 Jan 21 13:47:15.443724 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 27/49] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:15 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1222 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:15.651799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:15.695466 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7fc84a74-639b-4585-911e-f6450a5cbe3e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 3.040916 Jan 21 13:47:15.697760 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 23/50] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:12 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 3046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:15.806292 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-635676661", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:15.968911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] validate_networks() for [('8def9da6-8338-4654-a529-ca0ba4b105e0', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:47:16.202492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:16.205147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:16.221997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:16.223970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:16.225372 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:16.226040 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:16.394327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:16.423609 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a25a5313-f153-45df-8f24-969836135685 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1271 microversion: 2.1 time: 0.237395 Jan 21 13:47:16.427736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 24/51] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:16 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:16.719386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:16.726690 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:16.759557 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:16.760526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:16.764060 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:16.778270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:18.678654 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:18.689083 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4c7f1616-68e7-4c6d-b372-c3db08bdbc99 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 1.978441 Jan 21 13:47:18.709723 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 25/52] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:16 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:18.714630 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:18.735133 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:18.749494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:18.749958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:18.750758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:18.751197 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:20.019549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:47:20.020931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:47:20.021880 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:47:20.023244 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:47:20.024106 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:47:20.053187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:20.055945 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:20.059273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:20.062350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:20.122592 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Getting quotas for project 129b530f15584103a5bf73d0a63e801d. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:20.137082 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Getting quotas for user 8122bf15cfa8466db22e7046a22c1345 and project 129b530f15584103a5bf73d0a63e801d. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:20.174122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:47:20.184947 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:47:20.297667 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-03c0e885-623e-458f-9edf-b7caadb32a1a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.493731 Jan 21 13:47:20.333367 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 28/53] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:47:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 4527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:47:20.365919 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:20.366566 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:20.389283 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:20.389743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:20.390604 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:20.390991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:20.937019 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:20.958808 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-72f7260d-3437-4ede-91af-7ab96efdff90 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 2.245809 Jan 21 13:47:20.961057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 26/54] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:18 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:20.980305 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5eb083fe-adbe-4350-b8e8-d91f52f2a3b0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:20.981455 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5eb083fe-adbe-4350-b8e8-d91f52f2a3b0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:21.352422 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5eb083fe-adbe-4350-b8e8-d91f52f2a3b0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:21.369077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5eb083fe-adbe-4350-b8e8-d91f52f2a3b0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1221 microversion: 2.1 time: 0.402062 Jan 21 13:47:21.371854 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 27/55] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:20 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1221 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:22.269836 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:22.280030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-da046e61-fb93-4c6c-b64d-1c70a4d6341a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 1.948861 Jan 21 13:47:22.280754 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-bcd07103-ab1f-466e-8dee-12ae3afeec1f req-0b4d834f-6b7c-4b02-8161-5a6fd627dbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f7e6fc-4849-4f12-bf71-4aada9d59f82", "tag": "50c7d8b5-1947-463c-a58a-50b21faf13db"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:22.283226 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:22.283226 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:22.298007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 29/56] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:20 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:22.311799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:22.312697 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:22.320204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-bcd07103-ab1f-466e-8dee-12ae3afeec1f req-0b4d834f-6b7c-4b02-8161-5a6fd627dbd3 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:22.328442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:22.329232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:22.330531 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-bcd07103-ab1f-466e-8dee-12ae3afeec1f req-0b4d834f-6b7c-4b02-8161-5a6fd627dbd3 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:22.331586 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:22.334625 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:22.439317 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-bcd07103-ab1f-466e-8dee-12ae3afeec1f req-0b4d834f-6b7c-4b02-8161-5a6fd627dbd3 service nova] Creating event network-changed:50c7d8b5-1947-463c-a58a-50b21faf13db for instance d1f7e6fc-4849-4f12-bf71-4aada9d59f82 on hv-cinder-82016 Jan 21 13:47:22.441393 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-bcd07103-ab1f-466e-8dee-12ae3afeec1f req-0b4d834f-6b7c-4b02-8161-5a6fd627dbd3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122813) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 21 13:47:22.447628 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-149e96e7-a7b9-407f-9c1c-130eb47cf4e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:22.468073 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-149e96e7-a7b9-407f-9c1c-130eb47cf4e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:22.470331 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-149e96e7-a7b9-407f-9c1c-130eb47cf4e0 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:22.477749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-149e96e7-a7b9-407f-9c1c-130eb47cf4e0 None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:22.519315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.compute.rpcapi [None req-149e96e7-a7b9-407f-9c1c-130eb47cf4e0 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 21 13:47:22.533058 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-149e96e7-a7b9-407f-9c1c-130eb47cf4e0 None None] Releasing lock "compute-rpcapi-router" {{(pid=122813) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 21 13:47:22.581288 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-149e96e7-a7b9-407f-9c1c-130eb47cf4e0 None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.203513 Jan 21 13:47:22.582189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 28/57] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:23.365197 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1dc752d4-44bf-4b69-a7e0-1754957695a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'create', calling method: .version_select at 0x7f51bc172310>, body: {"keypair": {"name": "tempest-keypair-407374827"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:23.461198 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-1dc752d4-44bf-4b69-a7e0-1754957695a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:23.481620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-1dc752d4-44bf-4b69-a7e0-1754957695a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for user a5f49de6688841e2b5aaa7f117278348 and project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:24.039565 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-1dc752d4-44bf-4b69-a7e0-1754957695a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:24.046392 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-1dc752d4-44bf-4b69-a7e0-1754957695a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for user a5f49de6688841e2b5aaa7f117278348 and project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:24.099234 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1dc752d4-44bf-4b69-a7e0-1754957695a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.515700 Jan 21 13:47:24.105384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 29/58] 10.222.0.84 () {60 vars in 1157 bytes} [Fri Jan 21 13:47:22 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:24.116632 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:24.117374 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:24.146105 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:24.163219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:24.165009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:24.175267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:24.279113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:24.287855 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-71e44ed4-e3b1-40fb-b2c7-287b71825bcd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 1.986095 Jan 21 13:47:24.291257 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 30/59] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:22 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:24.637550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-840bdf37-2876-4ca0-82d8-6cb991ea2d6b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'create', calling method: .version_select at 0x7f51bc1b63a0>, body: {"keypair": {"name": "tempest-keypair-2054856804"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:24.677441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-840bdf37-2876-4ca0-82d8-6cb991ea2d6b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:24.687339 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-840bdf37-2876-4ca0-82d8-6cb991ea2d6b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for user 658d59ce11804cd6a1c498bdffffbe18 and project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:24.781657 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:24.812769 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4ff44873-11d8-45c8-a7a6-c873a822de41 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1279 microversion: 2.1 time: 0.706146 Jan 21 13:47:24.814261 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 30/60] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:24 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1279 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:24.846491 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:24.855927 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:24.892529 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:24.893634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:24.895767 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:24.897378 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:24.928023 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-840bdf37-2876-4ca0-82d8-6cb991ea2d6b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:24.932571 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-840bdf37-2876-4ca0-82d8-6cb991ea2d6b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for user 658d59ce11804cd6a1c498bdffffbe18 and project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:24.948675 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-840bdf37-2876-4ca0-82d8-6cb991ea2d6b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.653488 Jan 21 13:47:24.949830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 31/61] 10.222.0.84 () {62 vars in 1198 bytes} [Fri Jan 21 13:47:24 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 655 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 21 13:47:25.060351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-c30f15f8-62a8-4311-b724-56497933d98d req-e5517cd4-404b-4d34-95e3-c574344ee38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f278c8b5-0dc5-4c49-8334-ab7285e0c4dd", "tag": "17dff18d-c781-461c-bf46-2db597f5d2f0"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:25.062998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:25.062998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:47:25.092996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-c30f15f8-62a8-4311-b724-56497933d98d req-e5517cd4-404b-4d34-95e3-c574344ee38f service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:25.093705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-c30f15f8-62a8-4311-b724-56497933d98d req-e5517cd4-404b-4d34-95e3-c574344ee38f service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:25.130459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-c30f15f8-62a8-4311-b724-56497933d98d req-e5517cd4-404b-4d34-95e3-c574344ee38f service nova] Creating event network-changed:17dff18d-c781-461c-bf46-2db597f5d2f0 for instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd on hv-cinder-82016 Jan 21 13:47:25.131255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-c30f15f8-62a8-4311-b724-56497933d98d req-e5517cd4-404b-4d34-95e3-c574344ee38f service nova] Acquired lock "compute-rpcapi-router" {{(pid=122814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 21 13:47:25.134798 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af07ad9-c79e-49e1-80fc-da7a07934ece None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:25.135458 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af07ad9-c79e-49e1-80fc-da7a07934ece None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:25.136415 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af07ad9-c79e-49e1-80fc-da7a07934ece None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:25.138783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af07ad9-c79e-49e1-80fc-da7a07934ece None None] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:25.159413 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.compute.rpcapi [None req-7af07ad9-c79e-49e1-80fc-da7a07934ece None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 21 13:47:25.160568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af07ad9-c79e-49e1-80fc-da7a07934ece None None] Releasing lock "compute-rpcapi-router" {{(pid=122814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 21 13:47:25.193559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7af07ad9-c79e-49e1-80fc-da7a07934ece None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241803 Jan 21 13:47:25.194478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 32/62] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:25.307819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:25.308512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:25.320669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:25.321143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:25.322003 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:25.324582 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:26.007440 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:26.029350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4009009a-5388-4816-b845-77fea05916b6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 1.196617 Jan 21 13:47:26.033145 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 31/63] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:24 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:26.059533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:26.061958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:26.082790 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:26.084820 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:26.085926 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:26.086800 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:26.278483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:26.308571 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-baa3e1c0-5de7-4300-96c2-779155310cba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1279 microversion: 2.1 time: 0.272774 Jan 21 13:47:26.335215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 32/64] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:26 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:27.050448 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:27.051279 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:27.052194 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:27.063954 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8c54a4c6-bdc2-470f-b1f3-f48c8328c321 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 1.758328 Jan 21 13:47:27.065419 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 33/65] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:25 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:27.073084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:27.074006 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:27.080300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:27.080838 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:27.334944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:27.336444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:27.345887 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:27.346860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:27.350402 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:27.360342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:27.943456 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:27.955739 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7c89e6e5-a3e4-4bdb-ae9d-7318dace208e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.908900 Jan 21 13:47:27.959677 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 33/66] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:27 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:28.049090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:28.059409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9b311012-cee5-4951-8385-148414f63a32 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1279 microversion: 2.1 time: 0.736127 Jan 21 13:47:28.064283 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 34/67] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:27 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1279 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:28.083000 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:28.083818 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:28.116532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:28.123401 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:28.127323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:28.131337 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:28.639713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:28.674897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f832c43a-f2d5-4200-9eac-82b15cb6e7cd tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.589738 Jan 21 13:47:28.687148 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 34/68] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:28 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:28.733698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-68240d56-9d54-4244-8871-ea74c880fedf req-712578f5-dee2-45ca-8086-28ea449e5cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12549874-6848-4a56-b964-807011e2d9be", "tag": "43e5e65d-1f21-4eef-8f7d-fc14bde05f74"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:28.735695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:28.735695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:47:28.763943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-68240d56-9d54-4244-8871-ea74c880fedf req-712578f5-dee2-45ca-8086-28ea449e5cf7 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:28.765695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-68240d56-9d54-4244-8871-ea74c880fedf req-712578f5-dee2-45ca-8086-28ea449e5cf7 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:28.788902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-68240d56-9d54-4244-8871-ea74c880fedf req-712578f5-dee2-45ca-8086-28ea449e5cf7 service nova] Creating event network-changed:43e5e65d-1f21-4eef-8f7d-fc14bde05f74 for instance 12549874-6848-4a56-b964-807011e2d9be on hv-cinder-82016 Jan 21 13:47:28.805201 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-68240d56-9d54-4244-8871-ea74c880fedf req-712578f5-dee2-45ca-8086-28ea449e5cf7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074902 Jan 21 13:47:28.806869 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 35/69] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:28.973279 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:28.973720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:28.982030 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:28.982479 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:28.983262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:28.983696 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:29.077913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:29.078599 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:29.091667 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:29.094568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:29.096274 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:29.096990 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:29.280233 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:29.288479 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-74b17fa2-3b4a-46b2-88dc-c36806248751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.216035 Jan 21 13:47:29.289395 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 36/70] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:29 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:29.375113 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:29.385862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-663985dd-2885-4e50-b307-1e8653e9fc2e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.416351 Jan 21 13:47:29.391402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 35/71] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:28 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:29.692395 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:29.693125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:29.703669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:29.704937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:29.705959 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:29.706693 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:29.889077 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:29.898361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1c4a1030-57c0-41c2-953a-5aa33ed8263d tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.210403 Jan 21 13:47:29.899192 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 37/72] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:29 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:30.173895 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1947460141", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "257b1f17-c2c3-4ac6-a932-3ddca797ac52"}], "security_groups": [{"name": "tempest-securitygroup--701981209"}], "key_name": "tempest-keypair-407374827", "user_data": "}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:30.307046 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:30.308241 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:30.315810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:30.316269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:30.317371 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:30.317898 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:30.364324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] validate_networks() for [('257b1f17-c2c3-4ac6-a932-3ddca797ac52', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:47:30.496470 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:30.505977 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d286630e-d730-4b3e-b711-86d5d4cd00c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.202708 Jan 21 13:47:30.507420 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 38/73] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:30 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:30.517962 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:30.518689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:30.525183 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:30.525695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:30.527059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:30.527674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:30.711351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:30.724442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-be443a08-7cb4-4e87-86f9-ad974eaf7daf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.215673 Jan 21 13:47:30.725511 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 39/74] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:30 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:30.827761 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-917435094", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ba9eaea-c320-46c7-b6bb-d0baef77b7da"}], "security_groups": [{"name": "tempest-securitygroup--262001460"}], "key_name": "tempest-keypair-2054856804", "user_data": "}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:30.951157 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] validate_networks() for [('5ba9eaea-c320-46c7-b6bb-d0baef77b7da', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:47:31.132593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:47:31.133112 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:47:31.133525 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:47:31.134213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:47:31.134852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:47:31.143583 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.144070 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.144970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.145419 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.164236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:31.168497 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for user a5f49de6688841e2b5aaa7f117278348 and project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:31.180838 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:47:31.183844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:47:31.239472 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fda0d354-85f4-4673-8286-9f6ab629dcc9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.071105 Jan 21 13:47:31.245872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 36/75] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:47:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:47:31.252151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:31.253183 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:31.261557 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.262219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.263483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.264001 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.370985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:47:31.371532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:47:31.373508 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:47:31.374223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:47:31.374870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:47:31.385363 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.385998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.386962 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.390272 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.426912 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:47:31.431682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for user 658d59ce11804cd6a1c498bdffffbe18 and project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:47:31.436288 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:31.443730 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0f72ebfe-d6c5-48b1-ba8f-cf77709a1759 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.196430 Jan 21 13:47:31.454579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:47:31.454579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:47:31.456428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 37/76] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:31 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:31.462521 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e5224c4c-c49a-4820-ae22-18c18b0f5493 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:31.463447 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e5224c4c-c49a-4820-ae22-18c18b0f5493 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:31.510695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8f6fa9da-9b97-46ee-a318-717cacd7a824 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.687464 Jan 21 13:47:31.518410 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 40/77] 10.222.0.84 () {62 vars in 1187 bytes} [Fri Jan 21 13:47:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 21 13:47:31.524422 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bf3a8679-3618-45af-b6f1-5b396e3d66ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:31.525297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bf3a8679-3618-45af-b6f1-5b396e3d66ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:31.529294 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e5224c4c-c49a-4820-ae22-18c18b0f5493 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:31.537923 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e5224c4c-c49a-4820-ae22-18c18b0f5493 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1237 microversion: 2.1 time: 0.080117 Jan 21 13:47:31.538522 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 38/78] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:31 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:31.557690 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:31.558314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:31.573843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.576153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.577973 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.579594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.670722 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bf3a8679-3618-45af-b6f1-5b396e3d66ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:31.685909 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bf3a8679-3618-45af-b6f1-5b396e3d66ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:31.687465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bf3a8679-3618-45af-b6f1-5b396e3d66ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:31.688598 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bf3a8679-3618-45af-b6f1-5b396e3d66ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1281 microversion: 2.20 time: 0.168953 Jan 21 13:47:31.689194 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 41/79] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:31 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:31.742400 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:31.743131 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:31.751167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.752954 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.754064 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:31.755472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:31.796427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:31.805054 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e8e0bea3-b572-4589-b239-9f19735e5b77 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.252878 Jan 21 13:47:31.806888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 39/80] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:31 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:32.438010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:32.464185 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:32.465248 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:32.467291 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ff3d0b1d-009a-48ef-9018-4c5b6cb7dfb2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.728564 Jan 21 13:47:32.470200 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 42/81] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:31 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:32.481830 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.482557 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.483548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.484144 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.569768 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:32.570638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:32.591216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.593022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.596142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.599490 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.698968 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:32.707600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d3059aa2-ef4e-414e-877f-f4758fcfbcb9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.248376 Jan 21 13:47:32.718208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 40/82] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:32 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:32.725225 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:32.725990 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:32.734909 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.735520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.736503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.737126 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.810718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:32.823738 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-54cd99c6-9bd1-4bb8-b371-8ef471c4fc38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1307 microversion: 2.1 time: 0.253905 Jan 21 13:47:32.828766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 43/83] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:32 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:32.835499 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:32.836752 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:32.865189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.867629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.868486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:32.868962 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:32.878620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:32.891868 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:32.896174 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:32.908793 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-76858b13-9042-4000-b435-091e8285ad0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1341 microversion: 2.20 time: 0.180438 Jan 21 13:47:32.908906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 41/84] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:32 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:33.178864 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:33.191180 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-649768a4-134d-41e4-86a1-f622866382b3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.363418 Jan 21 13:47:33.192828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 44/85] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:32 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:33.243598 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-a1594bf7-9691-427a-9761-6fcd01b1f1c1 req-8a7263c1-8e34-412e-98b9-3e6d6bc91680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56e7904-e470-43e9-a035-27f2bc6ac74b", "tag": "f0dbf2a1-2dd0-4ac6-989f-0d3217db9bc8"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:33.246719 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:33.246719 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:33.261197 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-a1594bf7-9691-427a-9761-6fcd01b1f1c1 req-8a7263c1-8e34-412e-98b9-3e6d6bc91680 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.261649 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-a1594bf7-9691-427a-9761-6fcd01b1f1c1 req-8a7263c1-8e34-412e-98b9-3e6d6bc91680 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.272830 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-a1594bf7-9691-427a-9761-6fcd01b1f1c1 req-8a7263c1-8e34-412e-98b9-3e6d6bc91680 service nova] Creating event network-changed:f0dbf2a1-2dd0-4ac6-989f-0d3217db9bc8 for instance e56e7904-e470-43e9-a035-27f2bc6ac74b on hv-cinder-82016 Jan 21 13:47:33.278696 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-a1594bf7-9691-427a-9761-6fcd01b1f1c1 req-8a7263c1-8e34-412e-98b9-3e6d6bc91680 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043681 Jan 21 13:47:33.279295 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 42/86] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:47:33.483774 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:33.484313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:33.490055 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.490502 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.491263 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.491684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.625192 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:33.632400 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-59e5f6bc-d7b4-4a5c-9650-8ab3a1072ffe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.152328 Jan 21 13:47:33.633014 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 45/87] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:33 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:33.725174 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:33.725858 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:33.731801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.732243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.733035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.733466 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.840998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:33.841605 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:33.847333 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.847772 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.848543 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.848997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.866579 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:33.874526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-592c7a5a-575f-44db-a9c7-7a313b03c4c8 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.153342 Jan 21 13:47:33.875188 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 43/88] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:33 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:33.907472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:33.914531 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2bff66c7-09f6-44b9-add2-6b902dd31f4f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1295 microversion: 2.1 time: 0.077267 Jan 21 13:47:33.915089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 46/89] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:33 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1295 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:33.928208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:33.928847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:33.935322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.935693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.936469 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:33.936927 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:33.994183 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:34.003821 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:34.005410 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:34.006534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f79dd1e8-2949-4ffc-be3d-67b114af4f0e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1341 microversion: 2.20 time: 0.082035 Jan 21 13:47:34.007090 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 44/90] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:33 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1341 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:34.209643 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:34.210278 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:34.217099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.217547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.218320 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.218754 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.351148 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:34.359204 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-63f79f07-411b-4264-af69-9b774896c2fd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.153633 Jan 21 13:47:34.359775 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 47/91] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:34 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:34.649969 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:34.650582 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:34.657548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.658095 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.659183 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.659732 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.790310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:34.798065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-40178f65-8ade-4bee-8a92-09877be13f6d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.151806 Jan 21 13:47:34.798642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 45/92] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:34 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:34.891497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:34.892104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:34.897963 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.898403 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.899162 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.899589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.932126 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:34.932776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:34.939018 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.939473 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.940264 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:34.940728 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:34.998646 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:35.005861 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6bb1b2b3-63ca-431a-940c-ab1ca7376170 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1295 microversion: 2.1 time: 0.077273 Jan 21 13:47:35.006439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 46/93] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:34 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1295 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:35.023333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:35.023929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:35.029871 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:35.030436 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:35.031150 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:35.031920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:35.032355 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:35.037951 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ffa91951-0b43-4920-8a60-52f6bd6136d4 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.150037 Jan 21 13:47:35.038522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 48/94] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:34 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:35.091690 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:35.099373 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:35.100918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:35.102014 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bf376788-42c6-453c-bbcf-d8ebb6d45c14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1341 microversion: 2.20 time: 0.082235 Jan 21 13:47:35.102576 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 47/95] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:35 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1341 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:47:35.375824 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:35.376427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:35.382428 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:35.382867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:35.383638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:35.384061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:35.816132 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:35.817023 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:35.823825 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:35.824431 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:35.827286 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:35.827793 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:35.845122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:35.902330 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b73efa97-9f3e-44a5-b888-4d1926563bcd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.526848 Jan 21 13:47:35.904758 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 49/96] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:35 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:36.027517 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:36.029261 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:36.040877 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.041629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:36.044779 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.045553 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:36.142016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:36.157488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-918af2f4-2ac3-497a-9870-1c869d3280a0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.345416 Jan 21 13:47:36.159327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 48/97] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:35 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:36.174906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:36.179646 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:36.195403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.199358 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:36.203230 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.203880 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:36.371463 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:36.383838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3b465e08-df06-44eb-9e13-5e55d1679cae tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1295 microversion: 2.1 time: 0.362338 Jan 21 13:47:36.397106 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 50/98] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:36 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1295 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:36.403743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:36.403915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:36.428723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.429597 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:36.432259 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.432766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:36.478563 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:36.486725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ddb8eddc-78fd-484d-abc3-4dec5bbac590 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.323748 Jan 21 13:47:36.489401 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 49/99] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:36 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:36.578399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:36.586389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:36.598649 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:36.600270 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-62be657c-adb8-4c74-b702-467abff3ae43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1339 microversion: 2.20 time: 0.201956 Jan 21 13:47:36.601357 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 51/100] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:36 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:36.921251 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:36.922701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:36.929626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.930262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:36.931089 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:36.931656 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.095469 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:37.103011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6f0a5a48-b48c-4aec-a1e1-d49ffd0ccb42 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.186569 Jan 21 13:47:37.103586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 50/101] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:36 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:37.175708 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:37.176265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:37.182857 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.183315 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.184138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.184626 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.410314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:37.410932 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:37.429944 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.430330 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.431153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.431638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.675828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:37.689058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e1e8209f-d04d-48cf-aaed-ba9fc779806e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.516417 Jan 21 13:47:37.703801 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 52/102] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:37 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:37.712076 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:37.716743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:37.733612 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.735767 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.736762 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.737280 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.738603 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:37.753379 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-97fab394-ae4b-494c-ba1d-951ac699fe19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.342389 Jan 21 13:47:37.763363 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 51/103] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:37 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:37.763363 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:37.769648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:37.784980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.785463 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:37.786338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:37.786924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:38.040737 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:38.054494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:38.057523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:38.063590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4ee20ba2-f821-42a7-93a5-44c6fad6d3d2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.305751 Jan 21 13:47:38.064981 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 52/104] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:37 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:38.321064 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-b5be9e78-f21a-45f5-b8ca-143d24328638 req-8d55c1fb-3b51-4e4d-b279-c0488ada473e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f278c8b5-0dc5-4c49-8334-ab7285e0c4dd", "name": "network-vif-plugged", "status": "completed", "tag": "17dff18d-c781-461c-bf46-2db597f5d2f0"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:38.323527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:38.323527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:38.334651 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b5be9e78-f21a-45f5-b8ca-143d24328638 req-8d55c1fb-3b51-4e4d-b279-c0488ada473e service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:38.335721 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b5be9e78-f21a-45f5-b8ca-143d24328638 req-8d55c1fb-3b51-4e4d-b279-c0488ada473e service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:38.351217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-b5be9e78-f21a-45f5-b8ca-143d24328638 req-8d55c1fb-3b51-4e4d-b279-c0488ada473e service nova] Creating event network-vif-plugged:17dff18d-c781-461c-bf46-2db597f5d2f0 for instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd on hv-cinder-82016 Jan 21 13:47:38.359443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-b5be9e78-f21a-45f5-b8ca-143d24328638 req-8d55c1fb-3b51-4e4d-b279-c0488ada473e service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290967 Jan 21 13:47:38.360674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 53/105] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:38.368063 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:38.369026 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:38.378647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:38.379366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:38.380547 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:38.381206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:38.382657 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:38.390959 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-96f1a818-f6ad-488d-8b46-53b9d5da8a19 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.685732 Jan 21 13:47:38.397987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 53/106] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:37 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:38.636247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:38.646022 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d05f894b-e90a-40b6-ad4e-e401cde2699d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.283983 Jan 21 13:47:38.657682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 54/107] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:38 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:38.710632 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:38.711238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:38.728193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:38.728550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:38.729361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:38.729790 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:38.771146 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:38.771751 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:38.778213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:38.779089 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:38.780462 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:38.781325 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:39.016878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:39.024137 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3c7b0919-6faf-4b53-9b93-4d74bdaec0e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.256944 Jan 21 13:47:39.031168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 55/108] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:38 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:39.083862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:39.085364 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:39.101748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:39.103142 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:39.104147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:39.104749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:39.253871 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:39.263932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c898ebc6-fecd-42db-aa36-11a737d92dd6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.557045 Jan 21 13:47:39.264810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 54/109] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:38 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:39.394852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:39.405493 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:39.409177 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:39.409380 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5fa859a7-105a-4fe3-a51b-32f9abf96fef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.330605 Jan 21 13:47:39.415682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:39.417051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:39.425859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 56/110] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:39 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:39.447260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:39.447868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:39.448800 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:39.455423 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:39.666108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:39.666974 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:39.673654 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:39.674466 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:39.678564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:39.680904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:39.971559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:39.984442 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a9da8ed7-8a2d-4711-8b43-567bd31ccaa8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.321718 Jan 21 13:47:39.985729 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 57/111] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:39 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:39.991305 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-e5082976-0d84-4054-b6a5-25e05d4c2004 req-f45fe839-8d56-4526-b801-8dc33894d143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59552fe-d2ae-43ad-bf63-f4d6958c05fc", "tag": "6727a4f0-5a23-4ef3-b87b-c106a6420440"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:39.993764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:39.993764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:40.002338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-e5082976-0d84-4054-b6a5-25e05d4c2004 req-f45fe839-8d56-4526-b801-8dc33894d143 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.003034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-e5082976-0d84-4054-b6a5-25e05d4c2004 req-f45fe839-8d56-4526-b801-8dc33894d143 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.019964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-e5082976-0d84-4054-b6a5-25e05d4c2004 req-f45fe839-8d56-4526-b801-8dc33894d143 service nova] Creating event network-changed:6727a4f0-5a23-4ef3-b87b-c106a6420440 for instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc on hv-cinder-82016 Jan 21 13:47:40.028315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-e5082976-0d84-4054-b6a5-25e05d4c2004 req-f45fe839-8d56-4526-b801-8dc33894d143 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039394 Jan 21 13:47:40.029455 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 58/112] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:40.049732 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:40.050731 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:40.066872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.067508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.068848 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.069488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.180094 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:40.189288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5d4f4d26-8ab2-445c-b666-bf0d3ab9c5ef tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.777486 Jan 21 13:47:40.189901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 55/113] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:39 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:40.281760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:40.282377 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:40.296685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.297147 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.297969 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.298374 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.455024 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:40.455866 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-01540ab1-f755-42f0-ba63-c09587221c17 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.410338 Jan 21 13:47:40.464494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 59/114] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:40 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:40.475082 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-4649dd0e-9a73-46c2-92ec-094b8328f0f2 req-23df7916-91fc-4a9c-8fe2-82f2a2f8bf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f7e6fc-4849-4f12-bf71-4aada9d59f82", "name": "network-vif-plugged", "status": "completed", "tag": "50c7d8b5-1947-463c-a58a-50b21faf13db"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:40.476833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:40.476833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:40.487128 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-4649dd0e-9a73-46c2-92ec-094b8328f0f2 req-23df7916-91fc-4a9c-8fe2-82f2a2f8bf3a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.487590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-4649dd0e-9a73-46c2-92ec-094b8328f0f2 req-23df7916-91fc-4a9c-8fe2-82f2a2f8bf3a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.500592 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-4649dd0e-9a73-46c2-92ec-094b8328f0f2 req-23df7916-91fc-4a9c-8fe2-82f2a2f8bf3a service nova] Creating event network-vif-plugged:50c7d8b5-1947-463c-a58a-50b21faf13db for instance d1f7e6fc-4849-4f12-bf71-4aada9d59f82 on hv-cinder-82016 Jan 21 13:47:40.507621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-4649dd0e-9a73-46c2-92ec-094b8328f0f2 req-23df7916-91fc-4a9c-8fe2-82f2a2f8bf3a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041172 Jan 21 13:47:40.508156 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 60/115] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:40.515340 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:40.532546 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:40.553512 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.554466 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.555606 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:40.556411 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:40.913547 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:40.921823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:40.928753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:40.930112 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ed455f71-f48e-4614-a76b-0a64e250b4c0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.420807 Jan 21 13:47:40.932593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 61/116] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:40 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:41.005543 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:41.006896 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:41.015856 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.016315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:41.017226 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.017662 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:41.064572 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:41.080490 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-62fb3689-b5f8-465f-b471-6b246b4cc20e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.803016 Jan 21 13:47:41.084058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 56/117] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:40 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:41.191802 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:41.199380 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-63c14a4d-16fc-40a4-8b35-0734feaf1c33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.200975 Jan 21 13:47:41.200221 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 62/118] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:40 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:41.209582 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:41.210287 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:41.218892 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.219577 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:41.220507 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.221120 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:41.483645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:41.485218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:41.492133 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.493489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:41.494736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.495455 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:41.538258 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:41.550581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7f42ddfa-ceea-432e-ac85-3f665ac78d73 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1313 microversion: 2.1 time: 0.344608 Jan 21 13:47:41.554612 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 57/119] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:41 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:41.643861 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:41.656165 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4e39d892-2e25-4157-860f-66dbf5f9cabd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.177417 Jan 21 13:47:41.657526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 63/120] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:41 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:41.951173 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:41.952269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:41.960086 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.960533 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:41.961334 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:41.961759 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.060238 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-8a2ac34b-6606-4664-a6bb-7899526a639d req-4bb07610-753c-4be9-80c1-19c5b0bde826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade", "tag": "13e896be-af8b-4c5b-b2fe-cd245c3385d1"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:42.062428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:42.062428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:42.077135 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-8a2ac34b-6606-4664-a6bb-7899526a639d req-4bb07610-753c-4be9-80c1-19c5b0bde826 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.079383 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-8a2ac34b-6606-4664-a6bb-7899526a639d req-4bb07610-753c-4be9-80c1-19c5b0bde826 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.110481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-8a2ac34b-6606-4664-a6bb-7899526a639d req-4bb07610-753c-4be9-80c1-19c5b0bde826 service nova] Creating event network-changed:13e896be-af8b-4c5b-b2fe-cd245c3385d1 for instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade on hv-cinder-82016 Jan 21 13:47:42.128065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-8a2ac34b-6606-4664-a6bb-7899526a639d req-4bb07610-753c-4be9-80c1-19c5b0bde826 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072265 Jan 21 13:47:42.128872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 64/121] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:47:42.134777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:42.135475 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:42.148665 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.149117 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.149898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.156460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.319809 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:42.342859 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:42.349899 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:42.353164 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d66f988e-f2c4-4a96-a8fa-191e5f2753a4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.406269 Jan 21 13:47:42.354134 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 58/122] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:41 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:42.360748 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:42.361737 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:42.370562 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.371847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.373234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.373856 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.551526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:42.559682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7f333f6f-660f-4b36-85bf-8638d73a0b7b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1317 microversion: 2.1 time: 0.428593 Jan 21 13:47:42.560277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 65/123] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:42 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:42.579686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-afa5ef0e-b081-44e6-8fbb-b257fd96e536 req-4b1f344c-4578-4d95-86a6-3921c544e1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12549874-6848-4a56-b964-807011e2d9be", "name": "network-vif-plugged", "status": "completed", "tag": "43e5e65d-1f21-4eef-8f7d-fc14bde05f74"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:42.584993 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:42.584993 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:42.588707 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-afa5ef0e-b081-44e6-8fbb-b257fd96e536 req-4b1f344c-4578-4d95-86a6-3921c544e1b5 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.589315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-afa5ef0e-b081-44e6-8fbb-b257fd96e536 req-4b1f344c-4578-4d95-86a6-3921c544e1b5 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.607065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-afa5ef0e-b081-44e6-8fbb-b257fd96e536 req-4b1f344c-4578-4d95-86a6-3921c544e1b5 service nova] Creating event network-vif-plugged:43e5e65d-1f21-4eef-8f7d-fc14bde05f74 for instance 12549874-6848-4a56-b964-807011e2d9be on hv-cinder-82016 Jan 21 13:47:42.626473 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-afa5ef0e-b081-44e6-8fbb-b257fd96e536 req-4b1f344c-4578-4d95-86a6-3921c544e1b5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064860 Jan 21 13:47:42.627438 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 66/124] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:42.643006 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:42.643733 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:42.654316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.655196 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.656095 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.656249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.921523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:42.936655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2b9e4feb-2a69-477b-8619-c740ea592fa0 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1500 microversion: 2.1 time: 0.307969 Jan 21 13:47:42.937381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 67/125] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:42 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1500 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:42.942445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:42.944086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:42.962974 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.963738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:42.964526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:42.965731 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:43.200841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:43.210807 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-08702068-4578-4344-bb92-0b64cdac6aaa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.271954 Jan 21 13:47:43.211949 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 68/126] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:42 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:43.270026 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:43.277539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0e20a2fb-4f2f-48d5-9915-2ce8b8ea9f05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.921968 Jan 21 13:47:43.278590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 59/127] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:42 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:43.373968 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:43.374690 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:43.381529 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:43.382081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:43.383053 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:43.383782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:43.575365 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:43.576543 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:43.577197 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:43.586628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:43.588237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:43.589414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:43.589959 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:43.590905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:43.595588 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:43.597271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8abc588f-2e0f-4183-a7f9-9c7913bfb256 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.228860 Jan 21 13:47:43.597845 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 69/128] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:43 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:43.846274 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:43.868921 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-648f2d62-d0b7-4c10-807f-ba7c1eebd2d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1506 microversion: 2.1 time: 0.296884 Jan 21 13:47:43.881903 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 60/129] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:43 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:44.228514 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:44.229201 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:44.253736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.254426 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.255394 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.255858 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.298302 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:44.299209 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:44.307129 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.309243 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.311743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.312294 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.495886 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:44.505897 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8962a8f7-193b-4eb3-afc2-2624ca3c47cb tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.212709 Jan 21 13:47:44.510548 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 61/130] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:44 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:44.518939 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0bee7066-08b6-41e9-af6f-a8d715a85098 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26a603d1-dd7b-4fae-aa96-4894dd9a6842"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:44.523984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0bee7066-08b6-41e9-af6f-a8d715a85098 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:44.534266 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:44.538150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0bee7066-08b6-41e9-af6f-a8d715a85098 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.538894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0bee7066-08b6-41e9-af6f-a8d715a85098 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.540368 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0bee7066-08b6-41e9-af6f-a8d715a85098 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.541313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0bee7066-08b6-41e9-af6f-a8d715a85098 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.544234 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-eaa207bb-95c3-4f0d-b5fa-63c8462e567b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.319348 Jan 21 13:47:44.551830 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 70/131] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:44 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:44.615903 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:44.616576 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:44.623065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.623514 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.624520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.624983 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.919071 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0bee7066-08b6-41e9-af6f-a8d715a85098 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "POST /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407281 Jan 21 13:47:44.920326 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 62/132] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:47:44 2022] POST /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:44.926449 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-cccb97fc-3114-49a2-b8f5-682078cac20d req-4c262709-7b64-4679-b9e6-9dde4824defc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56e7904-e470-43e9-a035-27f2bc6ac74b", "name": "network-vif-plugged", "status": "completed", "tag": "f0dbf2a1-2dd0-4ac6-989f-0d3217db9bc8"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:44.928574 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:44.928574 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:47:44.940537 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-cccb97fc-3114-49a2-b8f5-682078cac20d req-4c262709-7b64-4679-b9e6-9dde4824defc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:44.941010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-cccb97fc-3114-49a2-b8f5-682078cac20d req-4c262709-7b64-4679-b9e6-9dde4824defc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:44.959748 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-cccb97fc-3114-49a2-b8f5-682078cac20d req-4c262709-7b64-4679-b9e6-9dde4824defc service nova] Creating event network-vif-plugged:f0dbf2a1-2dd0-4ac6-989f-0d3217db9bc8 for instance e56e7904-e470-43e9-a035-27f2bc6ac74b on hv-cinder-82016 Jan 21 13:47:44.965661 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-cccb97fc-3114-49a2-b8f5-682078cac20d req-4c262709-7b64-4679-b9e6-9dde4824defc service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043320 Jan 21 13:47:44.966474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 63/133] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:44.992527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:45.001837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:45.003340 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:45.004445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-aabef969-ff5c-48e0-ae19-9edc81112bd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.392845 Jan 21 13:47:45.013029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 71/134] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:44 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:47:45.468441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-89e1ae2b-6c08-4877-bea1-b6cea55d84b5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da98c1f5-1f33-412f-a0b2-9beaca0b9362"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:45.469596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-89e1ae2b-6c08-4877-bea1-b6cea55d84b5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:45.475692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-89e1ae2b-6c08-4877-bea1-b6cea55d84b5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:45.476197 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-89e1ae2b-6c08-4877-bea1-b6cea55d84b5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:45.476987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-89e1ae2b-6c08-4877-bea1-b6cea55d84b5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:45.477427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-89e1ae2b-6c08-4877-bea1-b6cea55d84b5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:45.527482 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:45.528130 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:45.534914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:45.535590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:45.536469 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:45.537813 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:45.685425 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:45.703367 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d89297d3-eb63-4d98-8f8e-9e46892b987f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.179530 Jan 21 13:47:45.707399 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 72/135] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:45 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:45.721813 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:45.722710 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:45.728812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:45.729256 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:45.730406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:45.731376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:45.919249 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-89e1ae2b-6c08-4877-bea1-b6cea55d84b5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454024 Jan 21 13:47:45.919897 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 64/136] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:47:45 2022] POST /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:45.950023 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:45.957418 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b66a52c8-8ffd-4352-8806-76c851b476a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.248799 Jan 21 13:47:45.958164 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 73/137] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:45 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:46.024533 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:46.025355 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:46.032160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:46.032603 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:46.033443 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:46.033876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:46.178855 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:46.190342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:46.191875 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:46.193152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-02f1e482-5223-49fe-9df8-dc134b11b255 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.173700 Jan 21 13:47:46.193718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 65/138] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:46 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:46.723946 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:46.724490 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:46.730336 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:46.731894 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:46.732703 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:46.733138 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:46.860187 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:46.867378 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1b9de6e7-6d90-43ff-838b-60cbee2dfa6b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.147294 Jan 21 13:47:46.867940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 74/139] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:46 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:46.974090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:46.974630 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:46.981507 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:46.981953 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:46.982722 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:46.983152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:47.115567 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:47.123426 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-251eb29d-129e-4579-ba5b-259618ea6877 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.152968 Jan 21 13:47:47.123991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 66/140] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:46 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:47.212502 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:47.213171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:47.220336 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:47.220891 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:47.221719 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:47.222155 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:47.349633 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:47.357750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:47.359254 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:47.360348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-52489830-1fd9-42c7-bc58-88491f478f51 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.151519 Jan 21 13:47:47.360944 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 75/141] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:47 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:47.884277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:47.884968 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:47.891451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:47.891895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:47.892739 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:47.893174 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:48.021148 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:48.029289 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-18ecfb23-a37d-4f95-87ee-37ae3474534d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.148719 Jan 21 13:47:48.029864 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 67/142] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:47 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:48.140409 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:48.141047 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:48.147012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:48.147452 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:48.148226 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:48.148699 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:48.275422 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:48.283970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5774d4fa-2728-4cea-8094-9a4db26e5401 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.147723 Jan 21 13:47:48.284542 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 76/143] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:48 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:48.378027 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:48.378625 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:48.384444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:48.384920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:48.385682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:48.386110 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:48.513026 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:48.520576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:48.522104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:48.523193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8589ade9-6af9-480b-a84c-46043e7a770d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.148879 Jan 21 13:47:48.523748 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 68/144] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:48 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:49.046711 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:49.047312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:49.053185 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:49.053630 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:49.054402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:49.054834 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:49.185874 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:49.194165 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-860c1b8f-e5d8-4852-a88d-569948e58268 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1321 microversion: 2.1 time: 0.151774 Jan 21 13:47:49.208104 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 77/145] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:49 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:49.300076 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:49.301443 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:49.308760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:49.309485 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:49.310351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:49.311022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:49.415166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-967f3e3d-0a70-4733-81b4-4015b6f63e23 req-bc42b0b5-00c4-4ecd-bdac-22c6b0ab1a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade", "name": "network-vif-plugged", "status": "completed", "tag": "13e896be-af8b-4c5b-b2fe-cd245c3385d1"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:49.417304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:49.417304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:49.425980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-967f3e3d-0a70-4733-81b4-4015b6f63e23 req-bc42b0b5-00c4-4ecd-bdac-22c6b0ab1a81 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:49.426448 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-967f3e3d-0a70-4733-81b4-4015b6f63e23 req-bc42b0b5-00c4-4ecd-bdac-22c6b0ab1a81 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:49.438363 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-967f3e3d-0a70-4733-81b4-4015b6f63e23 req-bc42b0b5-00c4-4ecd-bdac-22c6b0ab1a81 service nova] Creating event network-vif-plugged:13e896be-af8b-4c5b-b2fe-cd245c3385d1 for instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade on hv-cinder-82016 Jan 21 13:47:49.444088 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-967f3e3d-0a70-4733-81b4-4015b6f63e23 req-bc42b0b5-00c4-4ecd-bdac-22c6b0ab1a81 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Jan 21 13:47:49.444802 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 78/146] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:47:49.452121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:49.460457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-81307bdb-63bb-444d-9664-7e4f52421443 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.164003 Jan 21 13:47:49.470325 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 69/147] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:49 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:49.544356 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:49.545919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:49.554238 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:49.555348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:49.556500 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:49.557108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:49.731183 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:49.740323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:49.742215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:49.743501 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-540d9233-84e4-4ddd-bdcb-ff794cb1e93c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.205117 Jan 21 13:47:49.744139 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 79/148] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:49 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:50.210617 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:50.211240 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:50.218217 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.218972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.219940 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.220526 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.357889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:50.366102 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0b52a9d7-83c8-459a-ad7a-0b3372fadccf tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1515 microversion: 2.1 time: 0.159534 Jan 21 13:47:50.366725 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 70/149] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:50 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:50.383276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:50.384901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:50.393035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.393859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.394979 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.395489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.462538 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lazy-loading 'flavor' on Instance uuid e56e7904-e470-43e9-a035-27f2bc6ac74b {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:47:50.477735 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:50.478350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:50.484998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.485452 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.486244 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.486685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.610281 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-31a08ad7-50e4-46a7-8644-0e2c8a4df69e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b/action" status: 200 len: 32 microversion: 2.1 time: 0.230464 Jan 21 13:47:50.611138 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 80/150] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:47:50 2022] POST /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:47:50.623796 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:50.624243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:50.632786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.632786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.641283 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.641788 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.678894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:50.691159 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8f2ae50d-ebf3-423e-9295-1a24814f6c43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.216887 Jan 21 13:47:50.693796 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 71/151] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:50 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:50.762250 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:50.763385 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:50.769993 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.771117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.772182 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:50.772873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:50.937682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:50.947398 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4e21ed75-f34b-4134-8b0f-c11167829010 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.330285 Jan 21 13:47:50.947984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 81/152] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:50 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:51.094278 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:51.104468 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:51.107645 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:51.109282 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9fb8d3ec-2f29-4e12-9dc2-85fd7b99f8d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1406 microversion: 2.20 time: 0.351279 Jan 21 13:47:51.114942 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 72/153] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:50 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:47:51.477301 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-aea8c05c-5c31-4b47-bba7-b8ac05d40008 req-c600369f-5c49-4cec-9c92-56c8df9f3a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59552fe-d2ae-43ad-bf63-f4d6958c05fc", "name": "network-vif-plugged", "status": "completed", "tag": "6727a4f0-5a23-4ef3-b87b-c106a6420440"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:51.479124 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:51.479124 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:51.487608 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-aea8c05c-5c31-4b47-bba7-b8ac05d40008 req-c600369f-5c49-4cec-9c92-56c8df9f3a22 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:51.488188 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-aea8c05c-5c31-4b47-bba7-b8ac05d40008 req-c600369f-5c49-4cec-9c92-56c8df9f3a22 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:51.499362 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-aea8c05c-5c31-4b47-bba7-b8ac05d40008 req-c600369f-5c49-4cec-9c92-56c8df9f3a22 service nova] Creating event network-vif-plugged:6727a4f0-5a23-4ef3-b87b-c106a6420440 for instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc on hv-cinder-82016 Jan 21 13:47:51.508786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-aea8c05c-5c31-4b47-bba7-b8ac05d40008 req-c600369f-5c49-4cec-9c92-56c8df9f3a22 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034357 Jan 21 13:47:51.509119 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 82/154] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:47:51.709099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:51.709704 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:51.718990 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:51.719724 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:51.720722 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:51.721356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:51.870587 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:51.877840 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-13fe375f-9243-47d0-ab89-51720635c2fd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.172443 Jan 21 13:47:51.878623 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 73/155] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:51 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:51.966370 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:51.967057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:51.973395 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:51.973843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:51.974596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:51.975029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:52.109624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:52.116756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4760c969-7415-492f-be31-4d3621f358b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.155373 Jan 21 13:47:52.117315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 83/156] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:51 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:52.130761 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:52.131362 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:52.137992 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:52.138438 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:52.139209 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:52.139722 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:52.273820 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:52.282480 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:52.283983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:52.285638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-faced322-e080-4b1a-b47c-0ea657c3be53 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1599 microversion: 2.20 time: 0.158154 Jan 21 13:47:52.294295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 74/157] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:47:52 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:47:52.304487 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2cee1b33-43bf-48f5-8bb4-5ae02d65e6c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:52.305004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2cee1b33-43bf-48f5-8bb4-5ae02d65e6c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:52.311099 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2cee1b33-43bf-48f5-8bb4-5ae02d65e6c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:52.311542 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2cee1b33-43bf-48f5-8bb4-5ae02d65e6c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:52.312313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2cee1b33-43bf-48f5-8bb4-5ae02d65e6c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:52.312770 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2cee1b33-43bf-48f5-8bb4-5ae02d65e6c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:52.403433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2cee1b33-43bf-48f5-8bb4-5ae02d65e6c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102524 Jan 21 13:47:52.404023 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 84/158] 10.222.0.84 () {60 vars in 1315 bytes} [Fri Jan 21 13:47:52 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:47:52.896200 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:52.896831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:52.910925 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:52.911485 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:52.912287 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:52.912750 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.135216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:53.136035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:53.145532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.145992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.146794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.147227 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.185807 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:53.195239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b8b7da4e-da06-4a04-aca9-6556570a36f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1362 microversion: 2.1 time: 0.303224 Jan 21 13:47:53.201478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 75/159] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:52 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:53.521950 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:53.530311 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1d6e65ca-28f5-4faf-8b4f-6b93e7e48d05 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.399626 Jan 21 13:47:53.531358 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 85/160] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:53 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:53.558443 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:53.559733 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:53.565722 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.566203 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.567296 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.567807 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.592756 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:47:53.696772 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-088f4075-33eb-47a9-8be7-3ee7fc6bd0e1 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "DELETE /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 204 len: 0 microversion: 2.1 time: 0.141618 Jan 21 13:47:53.697608 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 76/161] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:47:53 2022] DELETE /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:47:53.706582 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:53.707372 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:53.713553 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.714027 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.715323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.715835 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.942621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:53.951989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-84430c44-fdad-48c9-8096-646c97645f26 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1552 microversion: 2.1 time: 0.249186 Jan 21 13:47:53.952911 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 86/162] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:53 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:53.987308 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-55e78ae8-2fb4-47e8-9094-b519ea168820 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:53.988388 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-55e78ae8-2fb4-47e8-9094-b519ea168820 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:53.993273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-f3608cd1-bc7b-4e82-9119-c50bdfa53901 req-31bb427d-0707-46bf-ba4a-cc8e08d62aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade", "tag": "13e896be-af8b-4c5b-b2fe-cd245c3385d1"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:53.997457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55e78ae8-2fb4-47e8-9094-b519ea168820 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.998175 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55e78ae8-2fb4-47e8-9094-b519ea168820 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:53.999181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55e78ae8-2fb4-47e8-9094-b519ea168820 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:53.999685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55e78ae8-2fb4-47e8-9094-b519ea168820 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.004780 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:54.004780 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:54.013129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-f3608cd1-bc7b-4e82-9119-c50bdfa53901 req-31bb427d-0707-46bf-ba4a-cc8e08d62aa2 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.013768 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-f3608cd1-bc7b-4e82-9119-c50bdfa53901 req-31bb427d-0707-46bf-ba4a-cc8e08d62aa2 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.032971 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-f3608cd1-bc7b-4e82-9119-c50bdfa53901 req-31bb427d-0707-46bf-ba4a-cc8e08d62aa2 service nova] Creating event network-changed:13e896be-af8b-4c5b-b2fe-cd245c3385d1 for instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade on hv-cinder-82016 Jan 21 13:47:54.037882 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-f3608cd1-bc7b-4e82-9119-c50bdfa53901 req-31bb427d-0707-46bf-ba4a-cc8e08d62aa2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048145 Jan 21 13:47:54.038481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 87/163] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:47:54.095426 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-55e78ae8-2fb4-47e8-9094-b519ea168820 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.111877 Jan 21 13:47:54.096220 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 77/164] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:47:53 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:54.227403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:54.228200 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:54.239280 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.241737 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.244788 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.245263 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.507263 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:54.515679 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d21c855f-9eb1-4295-9e65-faa8514f6182 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1547 microversion: 2.1 time: 0.292719 Jan 21 13:47:54.516503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 88/165] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:54 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1547 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:54.536386 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7c2765ed-d509-44b7-9235-c59e8a8bd46f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:54.537226 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7c2765ed-d509-44b7-9235-c59e8a8bd46f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:54.548273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7c2765ed-d509-44b7-9235-c59e8a8bd46f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.549200 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7c2765ed-d509-44b7-9235-c59e8a8bd46f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.550111 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7c2765ed-d509-44b7-9235-c59e8a8bd46f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.550763 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7c2765ed-d509-44b7-9235-c59e8a8bd46f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.561973 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:54.562584 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:54.578171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.578914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.584158 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.584725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.931476 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7c2765ed-d509-44b7-9235-c59e8a8bd46f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.400823 Jan 21 13:47:54.932591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 78/166] 10.222.0.84 () {58 vars in 1274 bytes} [Fri Jan 21 13:47:54 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-interface => generated 284 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:54.969600 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:54.970514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:54.977979 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.978532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:54.979775 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:54.980944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:55.017535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:55.025371 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-cae3941d-2732-4779-b96d-83690a1a04c3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.469486 Jan 21 13:47:55.035870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 89/167] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:54 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:55.108183 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-31dae82a-0438-4fc5-b94f-2779fa01bc89 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:55.109235 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-31dae82a-0438-4fc5-b94f-2779fa01bc89 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:55.117400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31dae82a-0438-4fc5-b94f-2779fa01bc89 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:55.118117 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31dae82a-0438-4fc5-b94f-2779fa01bc89 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:55.119152 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31dae82a-0438-4fc5-b94f-2779fa01bc89 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:55.120048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-31dae82a-0438-4fc5-b94f-2779fa01bc89 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:55.216768 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-31dae82a-0438-4fc5-b94f-2779fa01bc89 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.113569 Jan 21 13:47:55.220660 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 90/168] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:47:55 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:55.404279 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:55.416916 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-effc1cbc-56a3-4fa2-92f5-d9c386014429 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1552 microversion: 2.1 time: 0.451387 Jan 21 13:47:55.427839 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 79/169] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:54 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1552 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:56.044241 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:56.044901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:56.051303 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.051753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.052536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.052998 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.189545 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:56.196960 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0afa2f83-b659-4af6-aedd-857f5d24eb0e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.157405 Jan 21 13:47:56.197616 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 91/170] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:56 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:56.227404 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c3990682-95da-4416-9b82-9e9df445d889 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:56.228384 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c3990682-95da-4416-9b82-9e9df445d889 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:56.234973 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c3990682-95da-4416-9b82-9e9df445d889 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.235550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c3990682-95da-4416-9b82-9e9df445d889 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.236439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c3990682-95da-4416-9b82-9e9df445d889 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.236899 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c3990682-95da-4416-9b82-9e9df445d889 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.302012 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c3990682-95da-4416-9b82-9e9df445d889 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.078039 Jan 21 13:47:56.302668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 80/171] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:47:56 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:56.435096 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:56.435961 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:56.442382 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.442827 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.443609 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.444049 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.596952 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:56.604888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0bbc9ebc-9c26-488a-afda-00bd72232755 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1552 microversion: 2.1 time: 0.174114 Jan 21 13:47:56.606235 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 92/172] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:56 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:56.819177 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-521525a7-0a6c-4b28-8ea2-e6dd62d193a0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:56.820187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-521525a7-0a6c-4b28-8ea2-e6dd62d193a0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:56.827889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-521525a7-0a6c-4b28-8ea2-e6dd62d193a0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.828581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-521525a7-0a6c-4b28-8ea2-e6dd62d193a0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.829561 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-521525a7-0a6c-4b28-8ea2-e6dd62d193a0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.830152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-521525a7-0a6c-4b28-8ea2-e6dd62d193a0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.831415 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-e0766b8f-036f-4bc2-8139-4cd03f910006 req-e79884ef-751c-4fc1-93da-2ab139ae7f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59552fe-d2ae-43ad-bf63-f4d6958c05fc", "tag": "6727a4f0-5a23-4ef3-b87b-c106a6420440"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:56.833029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:56.833029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:47:56.843363 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-e0766b8f-036f-4bc2-8139-4cd03f910006 req-e79884ef-751c-4fc1-93da-2ab139ae7f86 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:56.844042 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-e0766b8f-036f-4bc2-8139-4cd03f910006 req-e79884ef-751c-4fc1-93da-2ab139ae7f86 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:56.869773 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-e0766b8f-036f-4bc2-8139-4cd03f910006 req-e79884ef-751c-4fc1-93da-2ab139ae7f86 service nova] Creating event network-changed:6727a4f0-5a23-4ef3-b87b-c106a6420440 for instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc on hv-cinder-82016 Jan 21 13:47:56.877211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-e0766b8f-036f-4bc2-8139-4cd03f910006 req-e79884ef-751c-4fc1-93da-2ab139ae7f86 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048923 Jan 21 13:47:56.878143 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 93/173] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:47:56.945553 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-521525a7-0a6c-4b28-8ea2-e6dd62d193a0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.130265 Jan 21 13:47:56.947844 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 81/174] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:47:56 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:47:57.215928 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:57.217782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:57.228195 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.229926 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:57.232682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.233404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:57.323216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a26707fd-a8a6-4eb0-bc24-edf0484b1598 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:57.326549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a26707fd-a8a6-4eb0-bc24-edf0484b1598 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:57.336040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a26707fd-a8a6-4eb0-bc24-edf0484b1598 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.337072 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a26707fd-a8a6-4eb0-bc24-edf0484b1598 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:57.338048 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a26707fd-a8a6-4eb0-bc24-edf0484b1598 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.338671 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a26707fd-a8a6-4eb0-bc24-edf0484b1598 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:57.424034 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a26707fd-a8a6-4eb0-bc24-edf0484b1598 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.109933 Jan 21 13:47:57.428544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 82/175] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:47:57 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:57.452483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:57.459902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b4767c0e-d301-43a5-8a46-1be424639247 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.248937 Jan 21 13:47:57.460798 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 94/176] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:57 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:57.630452 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:57.631525 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:57.642557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.643310 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:57.644115 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.644556 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:57.750505 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2448194319f54b5ebb927da1b0910ce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309a292210bd4c6b8f0f6d20524b6cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:57.759007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-472407b3-f377-46b6-9b72-ea8a382e5d1f tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 200 len: 1344 microversion: 2.1 time: 0.132619 Jan 21 13:47:57.760017 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 83/177] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:57 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 1344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:57.969558 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-75178f42-328c-4afe-a140-a2a72dd0c647 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:57.970491 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-75178f42-328c-4afe-a140-a2a72dd0c647 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:57.976748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75178f42-328c-4afe-a140-a2a72dd0c647 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.977200 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75178f42-328c-4afe-a140-a2a72dd0c647 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:57.978004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75178f42-328c-4afe-a140-a2a72dd0c647 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:57.978443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75178f42-328c-4afe-a140-a2a72dd0c647 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.066425 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-75178f42-328c-4afe-a140-a2a72dd0c647 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.100433 Jan 21 13:47:58.070228 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 95/178] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:47:57 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:47:58.435994 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d73a081d-bf38-46e6-a4e8-602c6d3cffd8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:58.436936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d73a081d-bf38-46e6-a4e8-602c6d3cffd8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:58.443707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d73a081d-bf38-46e6-a4e8-602c6d3cffd8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.444299 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d73a081d-bf38-46e6-a4e8-602c6d3cffd8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.445138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d73a081d-bf38-46e6-a4e8-602c6d3cffd8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.445581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d73a081d-bf38-46e6-a4e8-602c6d3cffd8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.478063 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:58.478932 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:58.486610 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.487058 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.487891 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.488322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.658693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:58.666106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-42a386a7-5acb-41f6-8a4a-f815fe0d7d4f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.192245 Jan 21 13:47:58.666738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 96/179] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:58 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:58.681640 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d73a081d-bf38-46e6-a4e8-602c6d3cffd8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.249862 Jan 21 13:47:58.685018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 84/180] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:47:58 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:47:58.776470 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:58.777811 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:58.784548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.785101 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.785878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.786314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.799839 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] HTTP exception thrown: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. Jan 21 13:47:58.800489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Returning 404 to user: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:58.801350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8eb3eaba-a818-4d8d-b5c4-d07958d39c8a tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 404 len: 111 microversion: 2.1 time: 0.028621 Jan 21 13:47:58.801892 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 97/181] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:58 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:47:58.893248 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-8fe97b94-a472-498e-8f68-14ad96370a05 req-05f7a8d5-0ff7-4ead-ad8e-12480f13c63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f278c8b5-0dc5-4c49-8334-ab7285e0c4dd", "name": "network-vif-deleted", "tag": "17dff18d-c781-461c-bf46-2db597f5d2f0"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:58.894737 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:47:58.894737 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:47:58.913988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-8fe97b94-a472-498e-8f68-14ad96370a05 req-05f7a8d5-0ff7-4ead-ad8e-12480f13c63d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.914432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-8fe97b94-a472-498e-8f68-14ad96370a05 req-05f7a8d5-0ff7-4ead-ad8e-12480f13c63d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.917035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:58.917972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:58.923755 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.924206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.925029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:58.925469 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:58.925731 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-8fe97b94-a472-498e-8f68-14ad96370a05 req-05f7a8d5-0ff7-4ead-ad8e-12480f13c63d service nova] Creating event network-vif-deleted:17dff18d-c781-461c-bf46-2db597f5d2f0 for instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd on hv-cinder-82016 Jan 21 13:47:58.930397 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-8fe97b94-a472-498e-8f68-14ad96370a05 req-05f7a8d5-0ff7-4ead-ad8e-12480f13c63d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041161 Jan 21 13:47:58.931142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 85/182] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:47:58.939417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] HTTP exception thrown: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. Jan 21 13:47:58.940034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Returning 404 to user: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:47:58.940887 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f3d1f32e-78e6-4d3b-bd2e-e5ad6a416081 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027613 Jan 21 13:47:58.941423 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 98/183] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:47:58 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:47:59.083550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-75c285db-5f73-462c-90b4-2a53933681e9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:59.084717 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-75c285db-5f73-462c-90b4-2a53933681e9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:59.092096 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75c285db-5f73-462c-90b4-2a53933681e9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:59.092549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75c285db-5f73-462c-90b4-2a53933681e9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:59.093452 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75c285db-5f73-462c-90b4-2a53933681e9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:59.094235 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75c285db-5f73-462c-90b4-2a53933681e9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:59.171876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-75c285db-5f73-462c-90b4-2a53933681e9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.093415 Jan 21 13:47:59.172408 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 86/184] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:47:59 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:47:59.684620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:47:59.686847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:59.694985 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:59.695446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:59.696238 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:59.696705 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:59.697770 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-75eca33f-8f07-4b12-84cf-ff36d52facc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:47:59.709883 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-75eca33f-8f07-4b12-84cf-ff36d52facc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:47:59.718992 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75eca33f-8f07-4b12-84cf-ff36d52facc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:59.719790 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75eca33f-8f07-4b12-84cf-ff36d52facc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:59.720895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75eca33f-8f07-4b12-84cf-ff36d52facc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:47:59.721540 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75eca33f-8f07-4b12-84cf-ff36d52facc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:47:59.800706 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-75eca33f-8f07-4b12-84cf-ff36d52facc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.110252 Jan 21 13:47:59.801605 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 87/185] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:47:59 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:47:59.863428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:47:59.873418 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-25ded55a-e3b3-4fa9-ae8e-3966c5f7834e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.193302 Jan 21 13:47:59.874116 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 99/186] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:47:59 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:00.135555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:00.136140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:00.143930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.144413 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.145225 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.145657 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.160455 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] HTTP exception thrown: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. Jan 21 13:48:00.161080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Returning 404 to user: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:48:00.161907 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-584889d6-9f30-4ea9-bf25-292611f3aef9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "DELETE /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 404 len: 111 microversion: 2.1 time: 0.030459 Jan 21 13:48:00.162512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 88/187] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:48:00 2022] DELETE /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:48:00.170252 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:00.170855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] [instance: f278c8b5-0dc5-4c49-8334-ab7285e0c4dd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:00.176540 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.177084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.178078 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.178532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.182905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c0f7b10a-2300-448a-a642-405faadc2b6e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:00.184649 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c0f7b10a-2300-448a-a642-405faadc2b6e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:00.191381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0f7b10a-2300-448a-a642-405faadc2b6e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.191867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0f7b10a-2300-448a-a642-405faadc2b6e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.192340 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] HTTP exception thrown: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. Jan 21 13:48:00.192746 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0f7b10a-2300-448a-a642-405faadc2b6e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.192954 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] Returning 404 to user: Instance f278c8b5-0dc5-4c49-8334-ab7285e0c4dd could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:48:00.193188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0f7b10a-2300-448a-a642-405faadc2b6e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.193762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-cc20785b-cd08-4583-a4ad-497b1144b2b9 tempest-DeleteServersTestJSON-998922190 tempest-DeleteServersTestJSON-998922190-project] 10.222.0.84 "GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd" status: 404 len: 111 microversion: 2.1 time: 0.027147 Jan 21 13:48:00.194298 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 100/188] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:00 2022] GET /compute/v2.1/servers/f278c8b5-0dc5-4c49-8334-ab7285e0c4dd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:48:00.270410 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c0f7b10a-2300-448a-a642-405faadc2b6e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.090970 Jan 21 13:48:00.271524 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 89/189] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:00 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:48:00.811207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-380afede-9274-42a9-b96e-3b3c7ee378b2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:00.812120 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-380afede-9274-42a9-b96e-3b3c7ee378b2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:00.819189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-380afede-9274-42a9-b96e-3b3c7ee378b2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.819646 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-380afede-9274-42a9-b96e-3b3c7ee378b2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.820428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-380afede-9274-42a9-b96e-3b3c7ee378b2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.821056 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-380afede-9274-42a9-b96e-3b3c7ee378b2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.890950 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:00.892315 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:00.896157 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-380afede-9274-42a9-b96e-3b3c7ee378b2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.088315 Jan 21 13:48:00.896920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 101/190] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:00 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:00.905827 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.906542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:00.907588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:00.908334 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:01.043178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1936875754", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "d3bfe002-b112-41ad-8d5b-fc9e48025c33"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:01.129518 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:01.137986 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8d2e92c5-a0ed-4afb-8e08-30acc7728a81 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.251483 Jan 21 13:48:01.139139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 90/191] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:00 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:01.282601 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6da6b57e-7564-4fc8-88c7-f029fd0f61c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:01.283665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6da6b57e-7564-4fc8-88c7-f029fd0f61c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:01.296293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6da6b57e-7564-4fc8-88c7-f029fd0f61c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:01.297104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6da6b57e-7564-4fc8-88c7-f029fd0f61c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:01.297966 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6da6b57e-7564-4fc8-88c7-f029fd0f61c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:01.298426 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6da6b57e-7564-4fc8-88c7-f029fd0f61c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:01.389294 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6da6b57e-7564-4fc8-88c7-f029fd0f61c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.111408 Jan 21 13:48:01.393457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 91/192] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:01 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:48:01.909214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1fc8a5c8-8d36-46dc-a962-829c1a4cf60b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:01.910348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1fc8a5c8-8d36-46dc-a962-829c1a4cf60b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:01.921971 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1fc8a5c8-8d36-46dc-a962-829c1a4cf60b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:01.922439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1fc8a5c8-8d36-46dc-a962-829c1a4cf60b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:01.923260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1fc8a5c8-8d36-46dc-a962-829c1a4cf60b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:01.923862 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1fc8a5c8-8d36-46dc-a962-829c1a4cf60b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:01.999011 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1fc8a5c8-8d36-46dc-a962-829c1a4cf60b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.094109 Jan 21 13:48:02.000545 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 92/193] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:01 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:02.158773 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:02.159550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:02.166914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:02.167465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:02.168392 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:02.168932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:02.320256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:02.328108 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-77839e14-bd56-4a47-a8d4-1ce8aaf995c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.173806 Jan 21 13:48:02.328705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 93/194] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:02 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:02.404098 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-82c91e00-2eba-4be8-a17d-ff9941dd0564 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:02.406053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-82c91e00-2eba-4be8-a17d-ff9941dd0564 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:02.413398 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82c91e00-2eba-4be8-a17d-ff9941dd0564 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:02.413905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82c91e00-2eba-4be8-a17d-ff9941dd0564 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:02.414769 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82c91e00-2eba-4be8-a17d-ff9941dd0564 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:02.415262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82c91e00-2eba-4be8-a17d-ff9941dd0564 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:02.506025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-82c91e00-2eba-4be8-a17d-ff9941dd0564 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.108961 Jan 21 13:48:02.507915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 94/195] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:02 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:48:03.011596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e6416d4e-9fc4-468b-9039-828a5d5c463e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:03.016371 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e6416d4e-9fc4-468b-9039-828a5d5c463e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:03.036847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6416d4e-9fc4-468b-9039-828a5d5c463e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:03.037635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6416d4e-9fc4-468b-9039-828a5d5c463e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:03.038724 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6416d4e-9fc4-468b-9039-828a5d5c463e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:03.039444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6416d4e-9fc4-468b-9039-828a5d5c463e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:03.124555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e6416d4e-9fc4-468b-9039-828a5d5c463e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.117445 Jan 21 13:48:03.125230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 95/196] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:03 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:03.345850 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:03.346557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:03.353603 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:03.354059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:03.354855 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:03.355298 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:03.529366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:03.541236 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9a497d0f-6c97-4835-8399-41718aa92b66 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.199606 Jan 21 13:48:03.541830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 96/197] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:03 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:03.549288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ba9ae442-1108-40ee-a3b8-614e34d72c46 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:03.550264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ba9ae442-1108-40ee-a3b8-614e34d72c46 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:03.559958 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba9ae442-1108-40ee-a3b8-614e34d72c46 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:03.560417 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba9ae442-1108-40ee-a3b8-614e34d72c46 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:03.561249 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba9ae442-1108-40ee-a3b8-614e34d72c46 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:03.561688 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba9ae442-1108-40ee-a3b8-614e34d72c46 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:03.659903 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ba9ae442-1108-40ee-a3b8-614e34d72c46 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.114202 Jan 21 13:48:03.660676 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 97/198] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:03 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:04.135804 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-57d810d7-00ae-4c5e-9d1e-6f84ab1c4341 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:04.137759 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-57d810d7-00ae-4c5e-9d1e-6f84ab1c4341 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:04.144749 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57d810d7-00ae-4c5e-9d1e-6f84ab1c4341 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:04.145506 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57d810d7-00ae-4c5e-9d1e-6f84ab1c4341 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:04.146360 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57d810d7-00ae-4c5e-9d1e-6f84ab1c4341 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:04.146988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57d810d7-00ae-4c5e-9d1e-6f84ab1c4341 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:04.240510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-57d810d7-00ae-4c5e-9d1e-6f84ab1c4341 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.108653 Jan 21 13:48:04.243952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 98/199] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:04 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:04.560805 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:04.561675 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:04.569629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:04.570186 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:04.571271 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:04.571782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:05.088369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:05.104027 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-685a7778-7ee6-4d3d-817b-c3a41d8e0011 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.548774 Jan 21 13:48:05.105239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 99/200] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:04 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:05.114680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c97bf124-dc64-45bd-a566-dc0f7b88e6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:05.116444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c97bf124-dc64-45bd-a566-dc0f7b88e6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:05.126595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c97bf124-dc64-45bd-a566-dc0f7b88e6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:05.127129 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c97bf124-dc64-45bd-a566-dc0f7b88e6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:05.128039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c97bf124-dc64-45bd-a566-dc0f7b88e6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:05.128484 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c97bf124-dc64-45bd-a566-dc0f7b88e6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:05.215764 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c97bf124-dc64-45bd-a566-dc0f7b88e6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.106542 Jan 21 13:48:05.215764 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 100/201] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:05 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:05.253293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-62c18532-ade9-4413-9475-4a6e7b5c87f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:05.254279 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-62c18532-ade9-4413-9475-4a6e7b5c87f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:05.262937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62c18532-ade9-4413-9475-4a6e7b5c87f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:05.268058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62c18532-ade9-4413-9475-4a6e7b5c87f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:05.268058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62c18532-ade9-4413-9475-4a6e7b5c87f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:05.268058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62c18532-ade9-4413-9475-4a6e7b5c87f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:05.375087 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-62c18532-ade9-4413-9475-4a6e7b5c87f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.125254 Jan 21 13:48:05.379174 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 101/202] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:05 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:06.123354 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:06.124057 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:06.138245 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:06.138922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:06.139806 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:06.140312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:06.305203 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:06.315948 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-828f6971-95c9-47dc-a2bb-43c1b97d2258 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.197163 Jan 21 13:48:06.316729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 102/203] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:06 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:06.330161 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de5ce1cf-a256-451b-8d2e-aec29984d88e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:06.333212 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de5ce1cf-a256-451b-8d2e-aec29984d88e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:06.342424 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de5ce1cf-a256-451b-8d2e-aec29984d88e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:06.342974 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de5ce1cf-a256-451b-8d2e-aec29984d88e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:06.343830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de5ce1cf-a256-451b-8d2e-aec29984d88e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:06.344366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de5ce1cf-a256-451b-8d2e-aec29984d88e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:06.455105 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de5ce1cf-a256-451b-8d2e-aec29984d88e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.136308 Jan 21 13:48:06.461141 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 103/204] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:06 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:06.468066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-224f8341-abc5-4508-a3a3-d4a2686f2bcf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:06.469898 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-224f8341-abc5-4508-a3a3-d4a2686f2bcf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:06.477755 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-224f8341-abc5-4508-a3a3-d4a2686f2bcf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:06.478448 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-224f8341-abc5-4508-a3a3-d4a2686f2bcf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:06.479309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-224f8341-abc5-4508-a3a3-d4a2686f2bcf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:06.479813 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-224f8341-abc5-4508-a3a3-d4a2686f2bcf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:06.567065 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-224f8341-abc5-4508-a3a3-d4a2686f2bcf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.103979 Jan 21 13:48:06.570514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 104/205] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:06 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:07.333080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:07.333777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:07.342252 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:07.342923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:07.343888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:07.344487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:07.527713 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:07.538684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-86e3d47e-38bb-45fc-b427-ec41e1ec46c9 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.209105 Jan 21 13:48:07.546771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 105/206] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:07 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:07.546771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bcea59d9-77b0-4b3f-a148-2179917646bf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:07.546771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bcea59d9-77b0-4b3f-a148-2179917646bf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:07.552357 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bcea59d9-77b0-4b3f-a148-2179917646bf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:07.552848 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bcea59d9-77b0-4b3f-a148-2179917646bf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:07.553746 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bcea59d9-77b0-4b3f-a148-2179917646bf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:07.554063 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bcea59d9-77b0-4b3f-a148-2179917646bf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:07.661242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bcea59d9-77b0-4b3f-a148-2179917646bf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.120641 Jan 21 13:48:07.662561 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 106/207] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:07 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:07.668972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c6335075-eaf3-4308-a36b-a51ebcc42c24 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:07.670604 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c6335075-eaf3-4308-a36b-a51ebcc42c24 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:07.677719 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6335075-eaf3-4308-a36b-a51ebcc42c24 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:07.678510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6335075-eaf3-4308-a36b-a51ebcc42c24 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:07.679516 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6335075-eaf3-4308-a36b-a51ebcc42c24 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:07.680121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6335075-eaf3-4308-a36b-a51ebcc42c24 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:07.776754 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c6335075-eaf3-4308-a36b-a51ebcc42c24 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.112556 Jan 21 13:48:07.778122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 107/208] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:07 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:08.566590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:08.568776 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:08.577165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:08.577998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:08.579707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:08.580344 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:08.740910 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:08.749283 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-85337783-8a6c-41d9-85ba-4acc4ba54412 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.190237 Jan 21 13:48:08.750031 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 108/209] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:08 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:08.756813 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9a64cbea-b44a-4fd9-be7b-8fab51524da9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:08.757894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9a64cbea-b44a-4fd9-be7b-8fab51524da9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:08.763930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a64cbea-b44a-4fd9-be7b-8fab51524da9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:08.764377 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a64cbea-b44a-4fd9-be7b-8fab51524da9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:08.765195 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a64cbea-b44a-4fd9-be7b-8fab51524da9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:08.765623 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a64cbea-b44a-4fd9-be7b-8fab51524da9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:08.843672 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9a64cbea-b44a-4fd9-be7b-8fab51524da9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.091744 Jan 21 13:48:08.846876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 109/210] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:08 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:08.849698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cd17e0a2-f334-4798-be65-7723d117a9ea tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:08.850835 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cd17e0a2-f334-4798-be65-7723d117a9ea tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:08.858788 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd17e0a2-f334-4798-be65-7723d117a9ea tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:08.859239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd17e0a2-f334-4798-be65-7723d117a9ea tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:08.860017 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd17e0a2-f334-4798-be65-7723d117a9ea tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:08.860450 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd17e0a2-f334-4798-be65-7723d117a9ea tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:08.939814 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cd17e0a2-f334-4798-be65-7723d117a9ea tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.093905 Jan 21 13:48:08.940718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 110/211] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:08 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:09.766619 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:09.767335 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:09.774153 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:09.774602 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:09.775393 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:09.775835 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:09.935894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:09.947009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a00f57bf-34c3-43b1-b620-3dc85629360c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.184463 Jan 21 13:48:09.947583 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 111/212] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:09 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:09.952675 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9cdc981b-6eee-4da8-8b88-55fbd73ed16d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:09.953580 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9cdc981b-6eee-4da8-8b88-55fbd73ed16d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:09.959372 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9cdc981b-6eee-4da8-8b88-55fbd73ed16d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:09.959783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9cdc981b-6eee-4da8-8b88-55fbd73ed16d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:09.960626 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9cdc981b-6eee-4da8-8b88-55fbd73ed16d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:09.961207 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9cdc981b-6eee-4da8-8b88-55fbd73ed16d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:10.037000 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9cdc981b-6eee-4da8-8b88-55fbd73ed16d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.088115 Jan 21 13:48:10.037665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 112/213] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:09 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:10.042958 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e18f74aa-71ce-48ed-995d-95275ef63014 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:10.044019 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e18f74aa-71ce-48ed-995d-95275ef63014 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:10.050922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e18f74aa-71ce-48ed-995d-95275ef63014 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:10.051332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e18f74aa-71ce-48ed-995d-95275ef63014 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:10.052119 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e18f74aa-71ce-48ed-995d-95275ef63014 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:10.052600 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e18f74aa-71ce-48ed-995d-95275ef63014 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:10.125930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e18f74aa-71ce-48ed-995d-95275ef63014 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 14 microversion: 2.20 time: 0.086684 Jan 21 13:48:10.127027 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 113/214] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:10 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:10.965466 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:10.966189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:10.974796 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:10.975403 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:10.976323 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:10.976823 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:11.122458 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:11.136629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2f518ada-74c8-4072-8ccc-09b1457431c0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.175856 Jan 21 13:48:11.137233 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 114/215] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:10 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:11.141848 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a808f4fa-c926-49c7-b76c-a58d63acbce8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:11.142769 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a808f4fa-c926-49c7-b76c-a58d63acbce8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:11.148642 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a808f4fa-c926-49c7-b76c-a58d63acbce8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:11.149116 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a808f4fa-c926-49c7-b76c-a58d63acbce8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:11.149901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a808f4fa-c926-49c7-b76c-a58d63acbce8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:11.150376 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a808f4fa-c926-49c7-b76c-a58d63acbce8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:14.129976 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a808f4fa-c926-49c7-b76c-a58d63acbce8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 2.991382 Jan 21 13:48:14.130683 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 115/216] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:11 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 2993 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:14.136083 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d9028057-ab6b-4cd5-b6f2-2f4d9630f5dd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:14.138089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d9028057-ab6b-4cd5-b6f2-2f4d9630f5dd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:14.145917 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9028057-ab6b-4cd5-b6f2-2f4d9630f5dd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:14.146446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9028057-ab6b-4cd5-b6f2-2f4d9630f5dd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:14.147347 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9028057-ab6b-4cd5-b6f2-2f4d9630f5dd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:14.147817 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9028057-ab6b-4cd5-b6f2-2f4d9630f5dd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:14.206881 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] validate_networks() for [('d3bfe002-b112-41ad-8d5b-fc9e48025c33', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:48:14.244304 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d9028057-ab6b-4cd5-b6f2-2f4d9630f5dd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 11207 microversion: 2.20 time: 0.112065 Jan 21 13:48:14.248388 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 116/217] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:14 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 11207 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:14.254041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:14.254823 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:14.261664 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:14.262213 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:14.263254 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:14.263890 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:14.428140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:14.436695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a5e7823a-8b72-4ac9-91b2-545e7b005aba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.186565 Jan 21 13:48:14.437628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 117/218] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:14 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:14.618935 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:48:14.619356 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:48:14.619833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:48:14.620247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:48:14.621171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:48:14.634720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:14.634720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:14.634720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:14.634720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:14.650246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:48:14.654545 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for user 8ef601f05ed04634bf325e21efbea29d and project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:48:14.666535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:48:14.669628 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:48:14.723406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-da801bac-e829-48b6-bf39-4ffbc2940885 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.685912 Jan 21 13:48:14.724577 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 102/219] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:48:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 13689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 21 13:48:14.735373 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d9df6517-aa1a-444d-bbf3-cde45f62dae1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:14.736242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d9df6517-aa1a-444d-bbf3-cde45f62dae1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:14.795353 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d9df6517-aa1a-444d-bbf3-cde45f62dae1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:14.804895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d9df6517-aa1a-444d-bbf3-cde45f62dae1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1218 microversion: 2.1 time: 0.071638 Jan 21 13:48:14.805648 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 118/220] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:14 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:15.145815 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-20ce0798-3bb2-4bde-bf90-248df8f3a04f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:15.148019 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-20ce0798-3bb2-4bde-bf90-248df8f3a04f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:15.157519 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-20ce0798-3bb2-4bde-bf90-248df8f3a04f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.158400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-20ce0798-3bb2-4bde-bf90-248df8f3a04f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.159978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-20ce0798-3bb2-4bde-bf90-248df8f3a04f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.160823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-20ce0798-3bb2-4bde-bf90-248df8f3a04f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.253690 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-20ce0798-3bb2-4bde-bf90-248df8f3a04f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 14 microversion: 2.1 time: 0.114614 Jan 21 13:48:15.256007 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 103/221] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:15 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:48:15.257501 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d8e73bbc-1063-428d-b96a-6cedfb3ccf41 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:15.258652 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d8e73bbc-1063-428d-b96a-6cedfb3ccf41 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:15.269498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8e73bbc-1063-428d-b96a-6cedfb3ccf41 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.269964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8e73bbc-1063-428d-b96a-6cedfb3ccf41 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.270873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8e73bbc-1063-428d-b96a-6cedfb3ccf41 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.271394 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8e73bbc-1063-428d-b96a-6cedfb3ccf41 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.364628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d8e73bbc-1063-428d-b96a-6cedfb3ccf41 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 15064 microversion: 2.20 time: 0.109437 Jan 21 13:48:15.365326 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 119/222] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:15 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 15064 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:15.456139 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:15.456988 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:15.465039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.465812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.466718 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.467161 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.615680 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:15.623559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5ecc65dd-46f5-4429-9cef-3faac4d63ea5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.171567 Jan 21 13:48:15.624176 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 104/223] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:15 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:15.822560 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:15.823431 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:15.831209 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.831655 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.832429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:15.832920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:15.918432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:15.925930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-80154020-ce4b-4ccb-b4cc-cc2da0ca32df tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1270 microversion: 2.1 time: 0.107337 Jan 21 13:48:15.926519 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 120/224] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:15 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:16.265754 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7160711d-150d-40dd-8767-0aeb2509eedf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:16.266671 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7160711d-150d-40dd-8767-0aeb2509eedf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:16.273597 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7160711d-150d-40dd-8767-0aeb2509eedf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:16.274058 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7160711d-150d-40dd-8767-0aeb2509eedf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:16.274842 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7160711d-150d-40dd-8767-0aeb2509eedf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:16.275281 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7160711d-150d-40dd-8767-0aeb2509eedf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:16.375336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3db51929-9baf-4a0c-aa37-8fe560b3606c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:16.376388 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3db51929-9baf-4a0c-aa37-8fe560b3606c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:16.382841 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db51929-9baf-4a0c-aa37-8fe560b3606c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:16.383338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db51929-9baf-4a0c-aa37-8fe560b3606c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:16.384090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db51929-9baf-4a0c-aa37-8fe560b3606c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:16.384533 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db51929-9baf-4a0c-aa37-8fe560b3606c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:18.608629 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7160711d-150d-40dd-8767-0aeb2509eedf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 8930 microversion: 2.1 time: 2.346266 Jan 21 13:48:18.609368 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 105/225] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:16 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 8930 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:18.614245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:18.615345 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:18.622712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:18.623193 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:18.623976 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:18.624734 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:18.628255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3db51929-9baf-4a0c-aa37-8fe560b3606c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 19226 microversion: 2.20 time: 2.256438 Jan 21 13:48:18.629351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 121/226] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:16 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 19226 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:18.634242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:18.634975 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:18.642659 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:18.643114 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:18.643904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:18.644340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:18.710195 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:18.718007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ba71c5fe-3854-4f78-918d-ac48dda1942d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1270 microversion: 2.1 time: 0.087403 Jan 21 13:48:18.718628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 122/227] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:18 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:18.833064 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:18.842146 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ca8baccb-96ec-4c2a-b2be-2ee4757cd7e0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.231530 Jan 21 13:48:18.842772 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 106/228] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:18 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:19.619636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b7b703e5-ac4a-489a-874a-4c75358e314e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:19.621181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b7b703e5-ac4a-489a-874a-4c75358e314e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:19.628175 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7b703e5-ac4a-489a-874a-4c75358e314e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.628647 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7b703e5-ac4a-489a-874a-4c75358e314e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.629445 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7b703e5-ac4a-489a-874a-4c75358e314e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.630047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7b703e5-ac4a-489a-874a-4c75358e314e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.640182 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-52a4076b-1786-4406-a6fc-bf64e78f3e2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:19.642100 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-52a4076b-1786-4406-a6fc-bf64e78f3e2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:19.660822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52a4076b-1786-4406-a6fc-bf64e78f3e2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.661356 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52a4076b-1786-4406-a6fc-bf64e78f3e2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.662228 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52a4076b-1786-4406-a6fc-bf64e78f3e2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.662764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-52a4076b-1786-4406-a6fc-bf64e78f3e2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.745074 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b7b703e5-ac4a-489a-874a-4c75358e314e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 13472 microversion: 2.1 time: 0.129330 Jan 21 13:48:19.746191 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 123/229] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:19 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 13472 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:19.751357 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:19.752689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:19.759412 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.760092 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.761591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.762185 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.782183 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-52a4076b-1786-4406-a6fc-bf64e78f3e2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 20277 microversion: 2.20 time: 0.146106 Jan 21 13:48:19.784054 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 107/230] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:19 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 20277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:19.861579 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:19.863316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:19.878585 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.879151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.880042 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:19.880753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:19.985733 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:19.996704 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ecbf010a-feeb-452f-a5b5-51b2fc2629ca tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.248029 Jan 21 13:48:19.997606 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 124/231] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:19 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:20.039375 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:20.050620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-db467814-59b9-40b8-a9a9-d3233a5c4751 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.194035 Jan 21 13:48:20.051896 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 108/232] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:19 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:20.550178 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-6e36f89f-594a-431b-9b7f-f98300db09d8 req-61321ece-770a-4103-a162-9078310f798a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f4ec04-0507-4d14-bd50-081d379d0ecf", "tag": "6158ddf8-bb57-41da-8425-5bb12d1f9863"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:20.552771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:48:20.552771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:48:20.563717 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6e36f89f-594a-431b-9b7f-f98300db09d8 req-61321ece-770a-4103-a162-9078310f798a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:20.564342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6e36f89f-594a-431b-9b7f-f98300db09d8 req-61321ece-770a-4103-a162-9078310f798a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:20.578140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-6e36f89f-594a-431b-9b7f-f98300db09d8 req-61321ece-770a-4103-a162-9078310f798a service nova] Creating event network-changed:6158ddf8-bb57-41da-8425-5bb12d1f9863 for instance b1f4ec04-0507-4d14-bd50-081d379d0ecf on hv-cinder-82016 Jan 21 13:48:20.584116 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-6e36f89f-594a-431b-9b7f-f98300db09d8 req-61321ece-770a-4103-a162-9078310f798a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041982 Jan 21 13:48:20.585336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 125/233] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:48:20.756682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-78968821-e7a9-428e-a0b5-1a60e6ad4c2f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:20.757538 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-78968821-e7a9-428e-a0b5-1a60e6ad4c2f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:20.764270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78968821-e7a9-428e-a0b5-1a60e6ad4c2f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:20.764746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78968821-e7a9-428e-a0b5-1a60e6ad4c2f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:20.765525 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78968821-e7a9-428e-a0b5-1a60e6ad4c2f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:20.765957 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78968821-e7a9-428e-a0b5-1a60e6ad4c2f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:20.794913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-594d2ef8-8f45-49ec-b8b9-86b8fc4c810a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:20.796806 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-594d2ef8-8f45-49ec-b8b9-86b8fc4c810a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:20.803415 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-594d2ef8-8f45-49ec-b8b9-86b8fc4c810a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:20.804085 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-594d2ef8-8f45-49ec-b8b9-86b8fc4c810a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:20.805061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-594d2ef8-8f45-49ec-b8b9-86b8fc4c810a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:20.805652 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-594d2ef8-8f45-49ec-b8b9-86b8fc4c810a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:20.880290 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-78968821-e7a9-428e-a0b5-1a60e6ad4c2f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 15275 microversion: 2.1 time: 0.127134 Jan 21 13:48:20.883784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 109/234] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:20 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 15275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:20.926531 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-594d2ef8-8f45-49ec-b8b9-86b8fc4c810a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 21727 microversion: 2.20 time: 0.136047 Jan 21 13:48:20.930281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 126/235] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:20 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 21727 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:21.014989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:21.016179 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:21.023037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.023496 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:21.024269 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.024925 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:21.067739 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:21.068760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:21.076595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.077148 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:21.078319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.078972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:21.189785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:21.198146 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b9bb67e1-8444-4f28-a34b-fa866b5a363b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.187736 Jan 21 13:48:21.210337 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 110/236] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:21 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:21.251579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:21.258930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c8ece407-c436-4531-9f01-240b47beaaf1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.195198 Jan 21 13:48:21.259511 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 127/237] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:21 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:21.891514 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f77996e3-6dbd-4268-a48c-d318f787a942 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:21.892423 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f77996e3-6dbd-4268-a48c-d318f787a942 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:21.898648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f77996e3-6dbd-4268-a48c-d318f787a942 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.899093 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f77996e3-6dbd-4268-a48c-d318f787a942 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:21.899868 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f77996e3-6dbd-4268-a48c-d318f787a942 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.900302 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f77996e3-6dbd-4268-a48c-d318f787a942 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:21.937985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-65af17d1-6a48-4e9e-9607-c821b8bb1336 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:21.938896 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-65af17d1-6a48-4e9e-9607-c821b8bb1336 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:21.945088 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65af17d1-6a48-4e9e-9607-c821b8bb1336 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.945533 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65af17d1-6a48-4e9e-9607-c821b8bb1336 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:21.946336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65af17d1-6a48-4e9e-9607-c821b8bb1336 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:21.946768 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65af17d1-6a48-4e9e-9607-c821b8bb1336 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:25.173794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f77996e3-6dbd-4268-a48c-d318f787a942 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 21463 microversion: 2.1 time: 3.285711 Jan 21 13:48:25.177444 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 111/238] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:21 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 21463 bytes in 3288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:25.179515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:25.180206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:25.187020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:25.187481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:25.188269 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:25.188740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:25.201015 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-65af17d1-6a48-4e9e-9607-c821b8bb1336 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 25006 microversion: 2.20 time: 3.266397 Jan 21 13:48:25.201924 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 128/239] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:21 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 25006 bytes in 3268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:25.209079 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:25.209923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:25.218175 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:25.218635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:25.219425 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:25.219865 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:25.326120 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:25.334112 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f0201f31-2b62-4216-92bc-9b818f6523d0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.158280 Jan 21 13:48:25.334693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 112/240] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:25 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:25.638182 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:25.645493 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cf7720c9-e53e-46cd-ac8e-8fcbc52f01a6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.442245 Jan 21 13:48:25.646063 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 129/241] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:25 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:26.185388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8d5957ea-8dc7-48a3-bf48-9eb4752081d8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:26.186322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8d5957ea-8dc7-48a3-bf48-9eb4752081d8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:26.192485 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d5957ea-8dc7-48a3-bf48-9eb4752081d8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.192964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d5957ea-8dc7-48a3-bf48-9eb4752081d8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.193753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d5957ea-8dc7-48a3-bf48-9eb4752081d8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.194206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d5957ea-8dc7-48a3-bf48-9eb4752081d8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.213146 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-975862fe-93d2-4a42-a6f9-1756f6ead4a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:26.215099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-975862fe-93d2-4a42-a6f9-1756f6ead4a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:26.221498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975862fe-93d2-4a42-a6f9-1756f6ead4a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.221967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975862fe-93d2-4a42-a6f9-1756f6ead4a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.222755 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975862fe-93d2-4a42-a6f9-1756f6ead4a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.223191 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975862fe-93d2-4a42-a6f9-1756f6ead4a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.281852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8d5957ea-8dc7-48a3-bf48-9eb4752081d8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 22119 microversion: 2.1 time: 0.100527 Jan 21 13:48:26.282517 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 113/242] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:26 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 22119 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:26.325526 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-975862fe-93d2-4a42-a6f9-1756f6ead4a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 25515 microversion: 2.20 time: 0.116220 Jan 21 13:48:26.326158 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 130/243] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:26 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 25515 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:26.352006 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:26.352724 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:26.360132 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.360594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.361394 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.361827 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.491676 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:26.499401 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-373762cc-94d0-4fbf-b1bb-b8d29aa58ba2 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.151435 Jan 21 13:48:26.499957 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 114/244] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:26 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:26.662755 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:26.663576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:26.670707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.671229 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.672156 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:26.672670 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:26.808681 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:26.816060 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ead3cb08-2834-4f91-a8b4-5d2075eb4a74 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.157391 Jan 21 13:48:26.816656 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 131/245] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:26 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:27.292975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-16a0369b-1433-47da-aefe-3d563a94db59 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:27.293898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-16a0369b-1433-47da-aefe-3d563a94db59 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:27.299882 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-16a0369b-1433-47da-aefe-3d563a94db59 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.300335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-16a0369b-1433-47da-aefe-3d563a94db59 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.301145 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-16a0369b-1433-47da-aefe-3d563a94db59 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.301587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-16a0369b-1433-47da-aefe-3d563a94db59 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.337007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8527f9d0-199c-4b35-905c-0c8a40524365 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:27.337929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8527f9d0-199c-4b35-905c-0c8a40524365 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:27.345441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8527f9d0-199c-4b35-905c-0c8a40524365 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.345894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8527f9d0-199c-4b35-905c-0c8a40524365 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.346685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8527f9d0-199c-4b35-905c-0c8a40524365 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.347119 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8527f9d0-199c-4b35-905c-0c8a40524365 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.393801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-16a0369b-1433-47da-aefe-3d563a94db59 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 23183 microversion: 2.1 time: 0.104372 Jan 21 13:48:27.394993 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 115/246] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:27 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 23183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:27.456407 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8527f9d0-199c-4b35-905c-0c8a40524365 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 26479 microversion: 2.20 time: 0.122940 Jan 21 13:48:27.457816 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 132/247] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:27 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 26479 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:27.515674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:27.516371 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:27.523533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.523992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.524804 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.525244 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.657569 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:27.665152 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-12b59ff0-d82a-4bdd-bb16-206bb5882f64 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.153536 Jan 21 13:48:27.665686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 116/248] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:27 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:27.832770 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:27.833393 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:27.841021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.841475 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.842331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:27.842772 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:27.973224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:27.980912 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6eab4351-5a88-4de9-8cc0-a9eda508b398 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.152257 Jan 21 13:48:27.981473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 133/249] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:27 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:28.406353 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-489a573a-d051-4d54-a930-ffd446069aea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:28.407264 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-489a573a-d051-4d54-a930-ffd446069aea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:28.414037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-489a573a-d051-4d54-a930-ffd446069aea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:28.414490 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-489a573a-d051-4d54-a930-ffd446069aea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:28.415271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-489a573a-d051-4d54-a930-ffd446069aea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:28.415712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-489a573a-d051-4d54-a930-ffd446069aea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:28.468483 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7775a51d-d1c1-4e6a-a17b-c4bdc0199b61 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:28.469410 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7775a51d-d1c1-4e6a-a17b-c4bdc0199b61 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:28.475754 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7775a51d-d1c1-4e6a-a17b-c4bdc0199b61 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:28.476209 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7775a51d-d1c1-4e6a-a17b-c4bdc0199b61 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:28.477162 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7775a51d-d1c1-4e6a-a17b-c4bdc0199b61 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:28.477475 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7775a51d-d1c1-4e6a-a17b-c4bdc0199b61 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:30.769048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-489a573a-d051-4d54-a930-ffd446069aea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 25316 microversion: 2.1 time: 2.367451 Jan 21 13:48:30.769698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 117/250] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:28 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 25316 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:30.774593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:30.775273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:30.782921 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:30.783384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:30.784140 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:30.784578 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:30.843391 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7775a51d-d1c1-4e6a-a17b-c4bdc0199b61 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 27544 microversion: 2.20 time: 2.378223 Jan 21 13:48:30.843943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 134/251] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:28 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 27544 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:30.848868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:30.849569 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:30.856562 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:30.857035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:30.857830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:30.858445 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:30.912631 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:30.920700 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-065e088f-bbca-436c-a640-cdb4fb9e5662 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.149706 Jan 21 13:48:30.921281 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 118/252] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:30 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:30.990809 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:30.998946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3cbeff37-acd5-4f19-99c2-ff2ccc28c12d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.153879 Jan 21 13:48:30.999567 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 135/253] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:30 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:31.781796 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fcb90683-dd6e-4a7a-b3fe-1663c2d829a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:31.783310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fcb90683-dd6e-4a7a-b3fe-1663c2d829a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:31.789988 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fcb90683-dd6e-4a7a-b3fe-1663c2d829a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:31.790441 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fcb90683-dd6e-4a7a-b3fe-1663c2d829a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:31.791237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fcb90683-dd6e-4a7a-b3fe-1663c2d829a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:31.792211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fcb90683-dd6e-4a7a-b3fe-1663c2d829a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:31.856020 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-01caacc4-68c2-4dc7-b874-43d8966e64c4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:31.857018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-01caacc4-68c2-4dc7-b874-43d8966e64c4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:31.863845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01caacc4-68c2-4dc7-b874-43d8966e64c4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:31.864301 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01caacc4-68c2-4dc7-b874-43d8966e64c4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:31.865183 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01caacc4-68c2-4dc7-b874-43d8966e64c4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:31.865674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01caacc4-68c2-4dc7-b874-43d8966e64c4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:31.899566 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fcb90683-dd6e-4a7a-b3fe-1663c2d829a3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 25835 microversion: 2.1 time: 0.123190 Jan 21 13:48:31.900263 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 119/254] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:31 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 25835 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:31.939389 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:31.940122 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:31.948120 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:31.948754 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:31.949562 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:31.950068 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:32.015723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-01caacc4-68c2-4dc7-b874-43d8966e64c4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 27754 microversion: 2.20 time: 0.163866 Jan 21 13:48:32.017062 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 136/255] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:31 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 27754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:32.022626 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:32.023319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:32.033834 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:32.034234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:32.035356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:32.036308 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:32.137229 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:32.145694 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c33730dd-0468-4270-8f85-8da3e9923cbb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.211116 Jan 21 13:48:32.146356 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 120/256] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:31 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:32.193535 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:32.203341 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-020fe2ca-5250-41bc-9349-9715e9f562d6 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.183992 Jan 21 13:48:32.204104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 137/257] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:32 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:32.912407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-11b01cf9-ccc4-401e-a6a9-b3345533d448 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:32.913393 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-11b01cf9-ccc4-401e-a6a9-b3345533d448 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:32.920514 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-11b01cf9-ccc4-401e-a6a9-b3345533d448 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:32.920999 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-11b01cf9-ccc4-401e-a6a9-b3345533d448 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:32.921776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-11b01cf9-ccc4-401e-a6a9-b3345533d448 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:32.922207 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-11b01cf9-ccc4-401e-a6a9-b3345533d448 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:33.016953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-11b01cf9-ccc4-401e-a6a9-b3345533d448 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 26286 microversion: 2.1 time: 0.108098 Jan 21 13:48:33.017620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 121/258] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:32 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 26286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:33.029773 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9756d1a0-bf65-4620-9264-6b0dd2b830ad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:33.030935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9756d1a0-bf65-4620-9264-6b0dd2b830ad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:33.042349 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756d1a0-bf65-4620-9264-6b0dd2b830ad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:33.042832 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756d1a0-bf65-4620-9264-6b0dd2b830ad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:33.043786 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756d1a0-bf65-4620-9264-6b0dd2b830ad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:33.044334 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756d1a0-bf65-4620-9264-6b0dd2b830ad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:33.169317 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:33.170509 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:33.178009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:33.178669 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:33.179791 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:33.180378 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:33.331842 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:33.341439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-188b0872-6877-410c-985a-b77dbe452121 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.177941 Jan 21 13:48:33.342003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 122/259] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:33 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:33.346260 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:33.346861 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:33.352603 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:33.353079 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:33.353850 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:33.354914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:33.491563 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:33.499421 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4b349bff-0735-4558-867c-abb0ec2c0998 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.156492 Jan 21 13:48:33.499989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 123/260] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:33 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:34.028360 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-eb077135-bb47-4a43-a079-0313705d3b96 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:34.029222 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-eb077135-bb47-4a43-a079-0313705d3b96 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:34.035757 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb077135-bb47-4a43-a079-0313705d3b96 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:34.036215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb077135-bb47-4a43-a079-0313705d3b96 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:34.037034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb077135-bb47-4a43-a079-0313705d3b96 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:34.037477 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb077135-bb47-4a43-a079-0313705d3b96 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:36.028293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9756d1a0-bf65-4620-9264-6b0dd2b830ad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28152 microversion: 2.20 time: 3.002777 Jan 21 13:48:36.030548 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 138/261] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:33 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28152 bytes in 3004 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:36.033999 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:36.034691 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:36.041526 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:36.042487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:36.043352 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:36.043763 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:36.062484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-eb077135-bb47-4a43-a079-0313705d3b96 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 27746 microversion: 2.1 time: 2.038194 Jan 21 13:48:36.063095 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 124/262] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:34 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 27746 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:48:36.067920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:36.068628 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:36.075408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:36.075937 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:36.077055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:36.077491 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:36.187427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:36.194718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b3200009-cf49-4026-8210-03f035c624c0 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.164609 Jan 21 13:48:36.195321 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 139/263] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:36 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:36.199978 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-09167bef-e5b7-4131-a20a-389cd489e4ef req-5d074561-1327-468c-8e9c-f0c9e4a71de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f4ec04-0507-4d14-bd50-081d379d0ecf", "name": "network-vif-plugged", "status": "completed", "tag": "6158ddf8-bb57-41da-8425-5bb12d1f9863"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:36.201544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:48:36.201544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:48:36.209354 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-09167bef-e5b7-4131-a20a-389cd489e4ef req-5d074561-1327-468c-8e9c-f0c9e4a71de0 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:36.210003 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-09167bef-e5b7-4131-a20a-389cd489e4ef req-5d074561-1327-468c-8e9c-f0c9e4a71de0 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:36.220849 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-09167bef-e5b7-4131-a20a-389cd489e4ef req-5d074561-1327-468c-8e9c-f0c9e4a71de0 service nova] Creating event network-vif-plugged:6158ddf8-bb57-41da-8425-5bb12d1f9863 for instance b1f4ec04-0507-4d14-bd50-081d379d0ecf on hv-cinder-82016 Jan 21 13:48:36.225943 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:36.227282 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-09167bef-e5b7-4131-a20a-389cd489e4ef req-5d074561-1327-468c-8e9c-f0c9e4a71de0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030742 Jan 21 13:48:36.227889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 140/264] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:48:36.234536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-de2b2165-6b05-4361-b2a0-9b9dec44bed2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.170311 Jan 21 13:48:36.235135 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 125/265] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:36 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:37.041829 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cec3da6d-0dd4-4c71-9012-3b27c8e89b91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:37.042828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cec3da6d-0dd4-4c71-9012-3b27c8e89b91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:37.049058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cec3da6d-0dd4-4c71-9012-3b27c8e89b91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:37.049509 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cec3da6d-0dd4-4c71-9012-3b27c8e89b91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:37.050292 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cec3da6d-0dd4-4c71-9012-3b27c8e89b91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:37.050731 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cec3da6d-0dd4-4c71-9012-3b27c8e89b91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:37.075204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-015b34d1-48e4-484c-80f0-b58c482e354d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:37.076257 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-015b34d1-48e4-484c-80f0-b58c482e354d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:37.083857 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015b34d1-48e4-484c-80f0-b58c482e354d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:37.084320 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015b34d1-48e4-484c-80f0-b58c482e354d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:37.085226 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015b34d1-48e4-484c-80f0-b58c482e354d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:37.085666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015b34d1-48e4-484c-80f0-b58c482e354d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:39.456473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cec3da6d-0dd4-4c71-9012-3b27c8e89b91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28152 microversion: 2.20 time: 2.418797 Jan 21 13:48:39.457546 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 141/266] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:37 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28152 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:39.463410 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:39.464873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:39.471309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:39.471753 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:39.472525 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:39.472984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:39.497912 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-015b34d1-48e4-484c-80f0-b58c482e354d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 27991 microversion: 2.1 time: 2.427056 Jan 21 13:48:39.501833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 126/267] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:37 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 27991 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:48:39.503476 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:39.504168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:39.512134 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:39.512602 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:39.513413 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:39.513854 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:39.609543 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:39.617353 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e9b4ee2d-e578-4545-b0b6-262f8bed2663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1318 microversion: 2.1 time: 0.158420 Jan 21 13:48:39.625869 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 142/268] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:39 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:39.647167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:39.655805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6dd6d6a7-e7e7-4f3d-9a33-00daa41450d7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.155795 Jan 21 13:48:39.656368 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 127/269] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:39 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:40.469051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-416ef03b-db53-4a50-8299-89ebd7781fb4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:40.469972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-416ef03b-db53-4a50-8299-89ebd7781fb4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:40.476172 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-416ef03b-db53-4a50-8299-89ebd7781fb4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.476636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-416ef03b-db53-4a50-8299-89ebd7781fb4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.477464 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-416ef03b-db53-4a50-8299-89ebd7781fb4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.477902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-416ef03b-db53-4a50-8299-89ebd7781fb4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.509399 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-15b335f7-440a-44f6-9248-b670eadf13c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:40.510314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-15b335f7-440a-44f6-9248-b670eadf13c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:40.517384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-15b335f7-440a-44f6-9248-b670eadf13c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.517840 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-15b335f7-440a-44f6-9248-b670eadf13c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.518624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-15b335f7-440a-44f6-9248-b670eadf13c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.519067 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-15b335f7-440a-44f6-9248-b670eadf13c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.554741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-416ef03b-db53-4a50-8299-89ebd7781fb4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28152 microversion: 2.20 time: 0.089414 Jan 21 13:48:40.557235 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 143/270] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:40 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:40.606299 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-15b335f7-440a-44f6-9248-b670eadf13c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28173 microversion: 2.1 time: 0.100406 Jan 21 13:48:40.606963 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 128/271] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:40 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28173 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:48:40.634990 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:40.636399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:40.644712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.645167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.645983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.646715 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.673420 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:40.674122 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:40.681375 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.681852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.682628 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.683235 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.791332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:40.800434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1c14f6f5-fbc1-4e19-b565-1a6cb489140d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1507 microversion: 2.1 time: 0.170061 Jan 21 13:48:40.801274 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 144/272] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:40 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:40.818166 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da98c1f5-1f33-412f-a0b2-9beaca0b9362"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:40.819219 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:40.826025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.826485 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.827284 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.827888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.834403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:40.842573 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ae43ded6-0857-4324-8218-6a0f3aff8910 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.173080 Jan 21 13:48:40.843212 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 129/273] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:40 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:40.907595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] HTTP exception thrown: Invalid volume: volume da98c1f5-1f33-412f-a0b2-9beaca0b9362 is already attached to instances: d1f7e6fc-4849-4f12-bf71-4aada9d59f82 Jan 21 13:48:40.908202 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Returning 400 to user: Invalid volume: volume da98c1f5-1f33-412f-a0b2-9beaca0b9362 is already attached to instances: d1f7e6fc-4849-4f12-bf71-4aada9d59f82 {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:48:40.909079 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-089bdc00-0105-4f97-9f2f-07b9cc3acb9a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094774 Jan 21 13:48:40.909642 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 145/274] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:48:40 2022] POST /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 21 13:48:40.968071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:40.968756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:40.975071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.975528 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:40.976309 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:40.976774 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.099391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lazy-loading 'services' on Instance uuid d1f7e6fc-4849-4f12-bf71-4aada9d59f82 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:48:41.215484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-37c30c0c-1aed-49aa-a832-1ea01a683580 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "DELETE /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments/da98c1f5-1f33-412f-a0b2-9beaca0b9362" status: 202 len: 0 microversion: 2.1 time: 0.251616 Jan 21 13:48:41.216064 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 130/275] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:48:40 2022] DELETE /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments/da98c1f5-1f33-412f-a0b2-9beaca0b9362 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:41.224555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-83489ab0-f30d-48d1-86c8-1dda2fddd9cf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:41.225550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-83489ab0-f30d-48d1-86c8-1dda2fddd9cf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:41.233316 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83489ab0-f30d-48d1-86c8-1dda2fddd9cf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.233780 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83489ab0-f30d-48d1-86c8-1dda2fddd9cf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.234561 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83489ab0-f30d-48d1-86c8-1dda2fddd9cf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.234991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83489ab0-f30d-48d1-86c8-1dda2fddd9cf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.267137 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-83489ab0-f30d-48d1-86c8-1dda2fddd9cf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Jan 21 13:48:41.270984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 146/276] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:48:41 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:48:41.567289 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f772b6f4-a6e1-496d-bddf-1df0dafc5c23 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:41.568473 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f772b6f4-a6e1-496d-bddf-1df0dafc5c23 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:41.574824 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f772b6f4-a6e1-496d-bddf-1df0dafc5c23 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.575395 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f772b6f4-a6e1-496d-bddf-1df0dafc5c23 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.576162 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f772b6f4-a6e1-496d-bddf-1df0dafc5c23 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.576591 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f772b6f4-a6e1-496d-bddf-1df0dafc5c23 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.619237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-277b8e37-7de0-47ca-915c-77adb7080674 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:41.620345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-277b8e37-7de0-47ca-915c-77adb7080674 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:41.627142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-277b8e37-7de0-47ca-915c-77adb7080674 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.627663 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-277b8e37-7de0-47ca-915c-77adb7080674 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.628674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-277b8e37-7de0-47ca-915c-77adb7080674 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.629127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-277b8e37-7de0-47ca-915c-77adb7080674 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.734671 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-277b8e37-7de0-47ca-915c-77adb7080674 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28173 microversion: 2.1 time: 0.119560 Jan 21 13:48:41.736705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 147/277] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:41 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28173 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:48:41.738078 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f772b6f4-a6e1-496d-bddf-1df0dafc5c23 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28152 microversion: 2.20 time: 0.175027 Jan 21 13:48:41.742326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 131/278] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:41 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28152 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:41.860758 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:41.861473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:41.868832 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.869281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:41.870065 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:41.871201 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:42.012357 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:42.019803 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-82604afa-c8d8-456e-91df-9fd74c959ba2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.163344 Jan 21 13:48:42.020331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 148/279] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:41 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:42.279133 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4129ee70-ae31-4b50-8374-2a2486a5174c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:42.280387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4129ee70-ae31-4b50-8374-2a2486a5174c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:42.288274 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4129ee70-ae31-4b50-8374-2a2486a5174c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:42.288776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4129ee70-ae31-4b50-8374-2a2486a5174c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:42.289569 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4129ee70-ae31-4b50-8374-2a2486a5174c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:42.290008 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4129ee70-ae31-4b50-8374-2a2486a5174c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:42.322574 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4129ee70-ae31-4b50-8374-2a2486a5174c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048038 Jan 21 13:48:42.323143 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 132/280] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:48:42 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:48:42.750017 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9d0e0166-2468-4af1-80f6-fd5092d6c6f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:42.751039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8d356809-66b0-44d4-a0b0-eb197f33a784 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:42.751424 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9d0e0166-2468-4af1-80f6-fd5092d6c6f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:42.751951 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8d356809-66b0-44d4-a0b0-eb197f33a784 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:42.760301 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9d0e0166-2468-4af1-80f6-fd5092d6c6f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:42.760848 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9d0e0166-2468-4af1-80f6-fd5092d6c6f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:42.761707 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d356809-66b0-44d4-a0b0-eb197f33a784 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:42.761950 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9d0e0166-2468-4af1-80f6-fd5092d6c6f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:42.762165 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d356809-66b0-44d4-a0b0-eb197f33a784 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:42.762399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9d0e0166-2468-4af1-80f6-fd5092d6c6f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:42.764768 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d356809-66b0-44d4-a0b0-eb197f33a784 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:42.773068 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d356809-66b0-44d4-a0b0-eb197f33a784 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:42.889795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9d0e0166-2468-4af1-80f6-fd5092d6c6f7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28173 microversion: 2.1 time: 0.144900 Jan 21 13:48:42.890918 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 149/281] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:42 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28173 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:42.918956 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8d356809-66b0-44d4-a0b0-eb197f33a784 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28152 microversion: 2.20 time: 0.171340 Jan 21 13:48:42.919980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 133/282] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:42 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28152 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:43.037865 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:43.038634 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:43.045557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:43.046015 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:43.046841 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:43.047286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:43.223180 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:43.238626 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b52ea3b9-04d1-4231-b7d1-4a438910bf2f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.204905 Jan 21 13:48:43.239670 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 150/283] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:43 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:43.335413 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-390bc7cc-8b0c-4da0-9f59-322b8840c565 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:43.336456 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-390bc7cc-8b0c-4da0-9f59-322b8840c565 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:43.344298 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-390bc7cc-8b0c-4da0-9f59-322b8840c565 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:43.344810 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-390bc7cc-8b0c-4da0-9f59-322b8840c565 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:43.345601 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-390bc7cc-8b0c-4da0-9f59-322b8840c565 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:43.346041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-390bc7cc-8b0c-4da0-9f59-322b8840c565 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:43.377411 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-390bc7cc-8b0c-4da0-9f59-322b8840c565 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046484 Jan 21 13:48:43.377970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 134/284] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:48:43 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:43.532130 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-19531334", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "d3bfe002-b112-41ad-8d5b-fc9e48025c33"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:43.598607 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] validate_networks() for [('d3bfe002-b112-41ad-8d5b-fc9e48025c33', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:48:43.903242 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e5663298-869d-45b1-8454-ae4b0315668d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:43.904386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e5663298-869d-45b1-8454-ae4b0315668d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:43.912327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5663298-869d-45b1-8454-ae4b0315668d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:43.923711 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5663298-869d-45b1-8454-ae4b0315668d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:43.925099 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5663298-869d-45b1-8454-ae4b0315668d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:43.925706 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5663298-869d-45b1-8454-ae4b0315668d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:44.044213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e5663298-869d-45b1-8454-ae4b0315668d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28173 microversion: 2.1 time: 0.145216 Jan 21 13:48:44.044961 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 135/285] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:43 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28173 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:44.060515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e613257c-e6a3-41e7-8558-8a3cd3f32cb7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:44.064114 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e613257c-e6a3-41e7-8558-8a3cd3f32cb7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:44.071741 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e613257c-e6a3-41e7-8558-8a3cd3f32cb7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:44.072535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e613257c-e6a3-41e7-8558-8a3cd3f32cb7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:44.074474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e613257c-e6a3-41e7-8558-8a3cd3f32cb7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:44.075051 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e613257c-e6a3-41e7-8558-8a3cd3f32cb7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:44.143560 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:48:44.144101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:48:44.144653 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:48:44.145432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:48:44.145432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:48:44.162959 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:44.163497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:44.164434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:44.164968 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:44.175189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e613257c-e6a3-41e7-8558-8a3cd3f32cb7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28184 microversion: 2.20 time: 0.128695 Jan 21 13:48:44.176138 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 136/286] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:44 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28184 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:44.183047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:48:44.190750 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for user 8ef601f05ed04634bf325e21efbea29d and project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:48:44.202261 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:48:44.204712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:48:44.251580 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8babc68b-edce-4661-87bf-1f906d0833a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723548 Jan 21 13:48:44.252579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 151/287] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:48:44.262546 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:44.262904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ca79202c-2c64-4d01-8337-960e5006b924 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:44.263689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ca79202c-2c64-4d01-8337-960e5006b924 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:44.264019 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:44.273721 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:44.275129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:44.276427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:44.277098 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:44.354661 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ca79202c-2c64-4d01-8337-960e5006b924 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:44.364837 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ca79202c-2c64-4d01-8337-960e5006b924 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1216 microversion: 2.1 time: 0.106143 Jan 21 13:48:44.371093 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 152/288] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:44 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:44.461709 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:44.470731 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-efbc2a40-3e52-43fd-9c2c-7014fad0cfed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1521 microversion: 2.1 time: 0.212474 Jan 21 13:48:44.471567 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 137/289] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:44 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:45.070092 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5a26f5c3-4bee-4971-bc20-032494acd563 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:45.075103 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5a26f5c3-4bee-4971-bc20-032494acd563 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:45.094150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a26f5c3-4bee-4971-bc20-032494acd563 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.094682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a26f5c3-4bee-4971-bc20-032494acd563 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.095705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a26f5c3-4bee-4971-bc20-032494acd563 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.096151 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a26f5c3-4bee-4971-bc20-032494acd563 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.188262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c79e54f7-255a-4827-9e8c-e21cb7ba6c7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:45.189214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c79e54f7-255a-4827-9e8c-e21cb7ba6c7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:45.196086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c79e54f7-255a-4827-9e8c-e21cb7ba6c7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.196593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c79e54f7-255a-4827-9e8c-e21cb7ba6c7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.197404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c79e54f7-255a-4827-9e8c-e21cb7ba6c7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.198357 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c79e54f7-255a-4827-9e8c-e21cb7ba6c7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.228836 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5a26f5c3-4bee-4971-bc20-032494acd563 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28460 microversion: 2.1 time: 0.167548 Jan 21 13:48:45.235259 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 153/290] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:45 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28460 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:45.314305 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c79e54f7-255a-4827-9e8c-e21cb7ba6c7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28443 microversion: 2.20 time: 0.128665 Jan 21 13:48:45.319255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 138/291] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:45 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28443 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:45.383660 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:45.384635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:45.396909 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.397951 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.400389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.401115 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.494446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:45.497087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:45.507680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:45.513615 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.514758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.516489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.518201 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.528420 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e09b331d-70af-4dd6-b445-3a8e5fc1899f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1268 microversion: 2.1 time: 0.149750 Jan 21 13:48:45.534262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 154/292] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:45 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:45.748796 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:45.757016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4ec4178a-32cf-49f2-b57b-0f1b0e5b16c5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1501 microversion: 2.1 time: 0.268998 Jan 21 13:48:45.759001 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 139/293] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:45 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:45.778528 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:45.779662 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:45.795682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.796921 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:45.798136 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:45.799324 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:46.062366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:46.071055 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e56d810d-37fb-4b19-8c8d-5bb2617d57b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1517 microversion: 2.1 time: 0.296843 Jan 21 13:48:46.072246 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 155/294] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:45 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1517 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:46.242263 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f3af8ee8-a2b0-46ec-bf82-f3d76d899682 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:46.244316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f3af8ee8-a2b0-46ec-bf82-f3d76d899682 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:46.252176 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3af8ee8-a2b0-46ec-bf82-f3d76d899682 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:46.252717 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3af8ee8-a2b0-46ec-bf82-f3d76d899682 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:46.253855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3af8ee8-a2b0-46ec-bf82-f3d76d899682 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:46.254757 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f3af8ee8-a2b0-46ec-bf82-f3d76d899682 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:46.327157 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f8716251-78f1-40cf-aec0-a2a0785a67c7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:46.328157 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f8716251-78f1-40cf-aec0-a2a0785a67c7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:46.341175 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8716251-78f1-40cf-aec0-a2a0785a67c7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:46.341674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8716251-78f1-40cf-aec0-a2a0785a67c7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:46.343342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8716251-78f1-40cf-aec0-a2a0785a67c7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:46.343787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8716251-78f1-40cf-aec0-a2a0785a67c7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:48.924669 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f3af8ee8-a2b0-46ec-bf82-f3d76d899682 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28462 microversion: 2.1 time: 2.686010 Jan 21 13:48:48.925326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 140/295] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:46 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28462 bytes in 2688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:48:48.934551 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:48.935455 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:48.943011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:48.943687 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:48.944721 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:48.945307 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:48.965669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f8716251-78f1-40cf-aec0-a2a0785a67c7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28611 microversion: 2.20 time: 2.642987 Jan 21 13:48:48.966742 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 156/296] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:46 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28611 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:49.318214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:49.326504 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0b298de2-cf74-4c9c-ada2-46abf7bf79ac tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 0.395938 Jan 21 13:48:49.327085 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 141/297] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:48 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:49.753348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:49.754713 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:49.767088 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:49.767852 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:49.768893 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:49.769526 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:49.844348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lazy-loading 'flavor' on Instance uuid 12549874-6848-4a56-b964-807011e2d9be {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:48:49.936110 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2a703fbf-08d5-453e-bd1e-8d9d26c5c54e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:49.937126 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2a703fbf-08d5-453e-bd1e-8d9d26c5c54e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:49.951034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2a703fbf-08d5-453e-bd1e-8d9d26c5c54e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:49.951494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2a703fbf-08d5-453e-bd1e-8d9d26c5c54e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:49.952285 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2a703fbf-08d5-453e-bd1e-8d9d26c5c54e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:49.953101 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2a703fbf-08d5-453e-bd1e-8d9d26c5c54e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.039895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2fe7870f-14cf-402f-83dc-3984bcbd280e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action" status: 200 len: 32 microversion: 2.1 time: 0.290109 Jan 21 13:48:50.041546 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 157/298] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:49 2022] POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:48:50.058903 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b6c1913b-e7b5-4764-b853-8f2d3132a9cf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:50.061890 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b6c1913b-e7b5-4764-b853-8f2d3132a9cf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:50.069408 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6c1913b-e7b5-4764-b853-8f2d3132a9cf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:50.069864 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6c1913b-e7b5-4764-b853-8f2d3132a9cf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.070862 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6c1913b-e7b5-4764-b853-8f2d3132a9cf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:50.071821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6c1913b-e7b5-4764-b853-8f2d3132a9cf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.087657 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2a703fbf-08d5-453e-bd1e-8d9d26c5c54e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28630 microversion: 2.1 time: 0.155643 Jan 21 13:48:50.089271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 142/299] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:49 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28630 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:48:50.119492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:50.128114 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:50.147056 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:50.149351 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.157365 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:50.158611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.261867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b6c1913b-e7b5-4764-b853-8f2d3132a9cf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28611 microversion: 2.20 time: 0.212532 Jan 21 13:48:50.264441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 158/300] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:50 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28611 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:50.275307 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-f65637c4-5964-4601-8ff6-bb44b4a55caf req-b3c93194-c49d-40a2-9f46-c2aa09fd2697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4262414e-91b5-4f61-9b5c-c51380f5fc46", "tag": "c58b0585-9bc6-4560-a4be-2cdbe88f5e2b"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:50.283650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:48:50.283650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:48:50.297121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f65637c4-5964-4601-8ff6-bb44b4a55caf req-b3c93194-c49d-40a2-9f46-c2aa09fd2697 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:50.301166 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f65637c4-5964-4601-8ff6-bb44b4a55caf req-b3c93194-c49d-40a2-9f46-c2aa09fd2697 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.338352 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-f65637c4-5964-4601-8ff6-bb44b4a55caf req-b3c93194-c49d-40a2-9f46-c2aa09fd2697 service nova] Creating event network-changed:c58b0585-9bc6-4560-a4be-2cdbe88f5e2b for instance 4262414e-91b5-4f61-9b5c-c51380f5fc46 on hv-cinder-82016 Jan 21 13:48:50.344819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-f65637c4-5964-4601-8ff6-bb44b4a55caf req-b3c93194-c49d-40a2-9f46-c2aa09fd2697 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075578 Jan 21 13:48:50.345438 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 159/301] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:48:50.360981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:50.361668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:50.379235 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:50.379696 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.380506 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:50.380971 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:50.650329 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:50.663747 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2f91c87d-41b1-4a18-b81c-7c1471677db1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.570614 Jan 21 13:48:50.665561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 143/302] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:50 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:50.946129 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:50.959129 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e2453949-9c07-4126-a9b0-4113932ab1e1 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 0.607256 Jan 21 13:48:50.959861 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 160/303] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:50 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:51.108494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9802b5ea-e57b-400a-bbcb-f5d1fa464971 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:51.110380 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9802b5ea-e57b-400a-bbcb-f5d1fa464971 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:51.123501 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9802b5ea-e57b-400a-bbcb-f5d1fa464971 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:51.124670 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9802b5ea-e57b-400a-bbcb-f5d1fa464971 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:51.125777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9802b5ea-e57b-400a-bbcb-f5d1fa464971 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:51.126344 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9802b5ea-e57b-400a-bbcb-f5d1fa464971 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:51.249076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9802b5ea-e57b-400a-bbcb-f5d1fa464971 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28630 microversion: 2.1 time: 0.144212 Jan 21 13:48:51.250216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 144/304] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:51 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28630 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:51.289752 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ec6db9f9-c41e-48e2-806d-e086e9b9a78e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:51.291461 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ec6db9f9-c41e-48e2-806d-e086e9b9a78e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:51.314489 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec6db9f9-c41e-48e2-806d-e086e9b9a78e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:51.315318 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec6db9f9-c41e-48e2-806d-e086e9b9a78e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:51.316337 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec6db9f9-c41e-48e2-806d-e086e9b9a78e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:51.319983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec6db9f9-c41e-48e2-806d-e086e9b9a78e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:51.399218 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ec6db9f9-c41e-48e2-806d-e086e9b9a78e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28611 microversion: 2.20 time: 0.120228 Jan 21 13:48:51.405652 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 161/305] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:51 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28611 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:51.684219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:51.685121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:51.708005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:51.708713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:51.710290 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:51.717050 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:51.977672 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:51.978541 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:51.997143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:52.002894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:52.003905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:52.004633 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:52.263775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:52.271192 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-10103ef8-139a-4c8d-a894-8bf75989fec0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.591967 Jan 21 13:48:52.284958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 145/306] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:51 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:52.294262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-400e05ce-7e13-4750-bd64-d8449558b10d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:52.298710 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-400e05ce-7e13-4750-bd64-d8449558b10d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:52.320459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:52.324250 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-400e05ce-7e13-4750-bd64-d8449558b10d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:52.325270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-400e05ce-7e13-4750-bd64-d8449558b10d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:52.326498 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-400e05ce-7e13-4750-bd64-d8449558b10d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:52.327150 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-400e05ce-7e13-4750-bd64-d8449558b10d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:52.328832 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-524b9cb7-7e01-42aa-9987-dafe640ea697 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 0.355100 Jan 21 13:48:52.329419 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 162/307] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:51 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:52.411777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8537763e-1506-49ee-bf1f-576ab0943e25 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:52.424387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8537763e-1506-49ee-bf1f-576ab0943e25 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:52.424387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8537763e-1506-49ee-bf1f-576ab0943e25 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:52.424387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8537763e-1506-49ee-bf1f-576ab0943e25 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:52.424387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8537763e-1506-49ee-bf1f-576ab0943e25 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:52.424773 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8537763e-1506-49ee-bf1f-576ab0943e25 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:52.435400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-400e05ce-7e13-4750-bd64-d8449558b10d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28630 microversion: 2.1 time: 0.148538 Jan 21 13:48:52.438960 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 146/308] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:52 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28630 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:52.524521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8537763e-1506-49ee-bf1f-576ab0943e25 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28611 microversion: 2.20 time: 0.116268 Jan 21 13:48:52.526779 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 163/309] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:52 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28611 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:48:53.289562 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:53.299603 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:53.313895 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.317923 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.318985 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.321611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.346893 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:53.347760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:53.360742 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.361406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.362556 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.363173 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.699864 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:53.703039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:53.720039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-56f678d1-77a2-4dea-8fbd-2310aaa1eaf6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 0.377503 Jan 21 13:48:53.722213 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 164/310] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:53 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:53.735466 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-448d0520-5eab-4757-be82-541b7f377fea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:53.737580 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-448d0520-5eab-4757-be82-541b7f377fea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:53.740013 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9da5b96e-c8d9-45ea-a708-a538a76eb438 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.454564 Jan 21 13:48:53.740590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 147/311] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:53 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:53.753487 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-aa69dc4f-7ea7-412f-856c-438d354bf358 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:53.754819 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-aa69dc4f-7ea7-412f-856c-438d354bf358 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:53.759972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448d0520-5eab-4757-be82-541b7f377fea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.761894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448d0520-5eab-4757-be82-541b7f377fea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.763121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448d0520-5eab-4757-be82-541b7f377fea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.765066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448d0520-5eab-4757-be82-541b7f377fea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.766484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa69dc4f-7ea7-412f-856c-438d354bf358 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.766940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa69dc4f-7ea7-412f-856c-438d354bf358 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.767756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa69dc4f-7ea7-412f-856c-438d354bf358 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:53.768185 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa69dc4f-7ea7-412f-856c-438d354bf358 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:53.882937 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-aa69dc4f-7ea7-412f-856c-438d354bf358 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28611 microversion: 2.20 time: 0.141061 Jan 21 13:48:53.888502 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 148/312] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:53 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28611 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:53.893304 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-448d0520-5eab-4757-be82-541b7f377fea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28630 microversion: 2.1 time: 0.167459 Jan 21 13:48:53.894316 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 165/313] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:53 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28630 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:54.741316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:54.743002 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:54.751923 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:54.752499 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:54.753797 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:54.754451 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:54.759293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:54.760159 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:54.781464 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:54.781924 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:54.782765 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:54.783204 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:55.040004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:55.048428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-69d15132-22e5-4e5e-a02c-c731fb5e1678 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 0.311317 Jan 21 13:48:55.053660 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 149/314] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:54 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:55.067007 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8d840f55-8889-4ae2-8c5b-d22bc3298c82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:55.068250 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8d840f55-8889-4ae2-8c5b-d22bc3298c82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:55.079754 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d840f55-8889-4ae2-8c5b-d22bc3298c82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:55.080805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d840f55-8889-4ae2-8c5b-d22bc3298c82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:55.081904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d840f55-8889-4ae2-8c5b-d22bc3298c82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:55.085214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d840f55-8889-4ae2-8c5b-d22bc3298c82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:55.111096 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:55.124107 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1e88fcdf-b565-45ff-8b95-b96d2f10a088 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.369299 Jan 21 13:48:55.125234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 166/315] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:54 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:48:55.129780 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-587f96d7-770d-4280-ab58-75e465b59761 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:55.130683 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-587f96d7-770d-4280-ab58-75e465b59761 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:55.145974 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-587f96d7-770d-4280-ab58-75e465b59761 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:55.146828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-587f96d7-770d-4280-ab58-75e465b59761 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:55.147932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-587f96d7-770d-4280-ab58-75e465b59761 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:55.148725 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-587f96d7-770d-4280-ab58-75e465b59761 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:55.193944 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8d840f55-8889-4ae2-8c5b-d22bc3298c82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28611 microversion: 2.20 time: 0.136596 Jan 21 13:48:55.198653 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 150/316] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:55 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28611 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:55.261212 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-587f96d7-770d-4280-ab58-75e465b59761 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28630 microversion: 2.1 time: 0.134553 Jan 21 13:48:55.261953 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 167/317] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:55 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28630 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:56.070911 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:56.071607 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:56.093960 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.095489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.096585 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.097278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.142672 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:56.143421 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:56.172826 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.173472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.176219 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.176936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.496879 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:56.510802 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:56.514035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7f552161-b1e1-4547-afd7-c1f6f1f58a0e tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 0.447259 Jan 21 13:48:56.527598 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 151/318] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:56 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:56.533481 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-335634fc-b42e-456a-858e-5b00fcd57d30 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.395475 Jan 21 13:48:56.536789 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 168/319] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:56 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:56.549858 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e045cc81-9480-43ed-8f7b-b2d3b27e2eee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:56.551761 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1466383e-e981-4784-9c2c-5006930ad8c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:56.553070 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e045cc81-9480-43ed-8f7b-b2d3b27e2eee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:56.557751 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1466383e-e981-4784-9c2c-5006930ad8c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:56.563156 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e045cc81-9480-43ed-8f7b-b2d3b27e2eee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.564045 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e045cc81-9480-43ed-8f7b-b2d3b27e2eee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.565912 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e045cc81-9480-43ed-8f7b-b2d3b27e2eee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.566656 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e045cc81-9480-43ed-8f7b-b2d3b27e2eee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.584393 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1466383e-e981-4784-9c2c-5006930ad8c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.586552 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1466383e-e981-4784-9c2c-5006930ad8c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.590470 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1466383e-e981-4784-9c2c-5006930ad8c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:56.591221 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1466383e-e981-4784-9c2c-5006930ad8c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:56.674586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e045cc81-9480-43ed-8f7b-b2d3b27e2eee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 28611 microversion: 2.20 time: 0.137410 Jan 21 13:48:56.676091 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 152/320] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:56 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 28611 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:56.731343 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1466383e-e981-4784-9c2c-5006930ad8c8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28630 microversion: 2.1 time: 0.193050 Jan 21 13:48:56.732230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 169/321] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:56 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28630 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:57.540900 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:57.542318 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:57.553861 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:57.558620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:57.580510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:57.583012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:57.583818 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:57.587595 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:57.589071 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:57.590138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:57.594777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:57.597265 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:58.122477 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:58.131723 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7adb8be5-d1e5-4af8-9b9e-d9437ca96ec5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 0.598505 Jan 21 13:48:58.133723 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 153/322] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:57 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:58.140010 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6420c1e2-048f-4def-8fbb-7c8b6c407082 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:58.141378 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6420c1e2-048f-4def-8fbb-7c8b6c407082 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:58.149920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6420c1e2-048f-4def-8fbb-7c8b6c407082 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:58.150617 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6420c1e2-048f-4def-8fbb-7c8b6c407082 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:58.151711 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6420c1e2-048f-4def-8fbb-7c8b6c407082 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:58.152343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6420c1e2-048f-4def-8fbb-7c8b6c407082 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:58.279386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6420c1e2-048f-4def-8fbb-7c8b6c407082 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 30066 microversion: 2.20 time: 0.144081 Jan 21 13:48:58.280775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 154/323] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:58 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 30066 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:58.288041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fc146410-226c-4b86-877b-9dc525741cd8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:58.291635 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fc146410-226c-4b86-877b-9dc525741cd8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:58.308773 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fc146410-226c-4b86-877b-9dc525741cd8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:58.309238 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fc146410-226c-4b86-877b-9dc525741cd8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:58.310132 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fc146410-226c-4b86-877b-9dc525741cd8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:58.310576 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fc146410-226c-4b86-877b-9dc525741cd8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:58.326928 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:58.334592 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b6233c32-c0d0-4a5e-912a-9667c6e2789e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.786374 Jan 21 13:48:58.335179 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 170/324] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:57 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:58.352826 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-3227bfdd-7825-459d-b3f7-07dbd0fae4fb req-1aad5cc4-67ff-4bc2-b038-49b9b03e43c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4262414e-91b5-4f61-9b5c-c51380f5fc46", "name": "network-vif-plugged", "status": "completed", "tag": "c58b0585-9bc6-4560-a4be-2cdbe88f5e2b"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:58.360997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:48:58.360997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:48:58.384752 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-3227bfdd-7825-459d-b3f7-07dbd0fae4fb req-1aad5cc4-67ff-4bc2-b038-49b9b03e43c8 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:58.385390 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-3227bfdd-7825-459d-b3f7-07dbd0fae4fb req-1aad5cc4-67ff-4bc2-b038-49b9b03e43c8 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:58.432439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-3227bfdd-7825-459d-b3f7-07dbd0fae4fb req-1aad5cc4-67ff-4bc2-b038-49b9b03e43c8 service nova] Creating event network-vif-plugged:c58b0585-9bc6-4560-a4be-2cdbe88f5e2b for instance 4262414e-91b5-4f61-9b5c-c51380f5fc46 on hv-cinder-82016 Jan 21 13:48:58.452368 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-3227bfdd-7825-459d-b3f7-07dbd0fae4fb req-1aad5cc4-67ff-4bc2-b038-49b9b03e43c8 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115952 Jan 21 13:48:58.453464 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 171/325] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:48:58.495273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fc146410-226c-4b86-877b-9dc525741cd8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 28776 microversion: 2.1 time: 0.212331 Jan 21 13:48:58.496009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 155/326] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:58 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 28776 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:48:59.151634 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:59.152434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:59.174437 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.175348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:59.176486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.176970 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:59.315334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3df0caf7-b430-49bb-99f0-fe160daa28d0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:59.317749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3df0caf7-b430-49bb-99f0-fe160daa28d0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:59.328883 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3df0caf7-b430-49bb-99f0-fe160daa28d0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.334166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3df0caf7-b430-49bb-99f0-fe160daa28d0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:59.335356 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3df0caf7-b430-49bb-99f0-fe160daa28d0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.336563 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3df0caf7-b430-49bb-99f0-fe160daa28d0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:59.505078 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3df0caf7-b430-49bb-99f0-fe160daa28d0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 31321 microversion: 2.20 time: 0.200663 Jan 21 13:48:59.505953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 156/327] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:48:59 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 31321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:48:59.513965 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:48:59.515832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:59.536448 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.542139 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:59.545685 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.546159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:59.827858 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:48:59.852500 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3640b647-a24e-40b6-b2a9-b365500ff152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.342164 Jan 21 13:48:59.865449 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 157/328] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:59 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:48:59.872564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4bdcdc60-c15f-4f47-a987-f5f612984f60 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:48:59.877041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4bdcdc60-c15f-4f47-a987-f5f612984f60 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:48:59.892841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bdcdc60-c15f-4f47-a987-f5f612984f60 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.894181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bdcdc60-c15f-4f47-a987-f5f612984f60 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:48:59.895309 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bdcdc60-c15f-4f47-a987-f5f612984f60 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:48:59.895975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bdcdc60-c15f-4f47-a987-f5f612984f60 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:00.007998 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4bdcdc60-c15f-4f47-a987-f5f612984f60 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 30493 microversion: 2.1 time: 0.140868 Jan 21 13:49:00.018347 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 158/329] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:48:59 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 30493 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:00.326639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:00.340601 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ab8eab88-c22e-4d50-ba4b-62cd9d29e809 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1316 microversion: 2.1 time: 1.191626 Jan 21 13:49:00.341595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 172/330] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:48:59 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1316 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:00.529002 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cd666926-8d78-495f-9834-bb3c70673b4a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:00.538198 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-cd666926-8d78-495f-9834-bb3c70673b4a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:00.554474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cd666926-8d78-495f-9834-bb3c70673b4a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:00.554924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cd666926-8d78-495f-9834-bb3c70673b4a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:00.559954 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cd666926-8d78-495f-9834-bb3c70673b4a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:00.560603 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cd666926-8d78-495f-9834-bb3c70673b4a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:00.714940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-cd666926-8d78-495f-9834-bb3c70673b4a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 32252 microversion: 2.20 time: 0.190551 Jan 21 13:49:00.715644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 159/331] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:00 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 32252 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:00.870689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:00.871609 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:00.879884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:00.880636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:00.881934 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:00.882593 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:01.020423 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-12fe6366-3a33-4ed8-a8c8-8bb340bdf9de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:01.021923 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-12fe6366-3a33-4ed8-a8c8-8bb340bdf9de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:01.029526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12fe6366-3a33-4ed8-a8c8-8bb340bdf9de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:01.030596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12fe6366-3a33-4ed8-a8c8-8bb340bdf9de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:01.031631 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12fe6366-3a33-4ed8-a8c8-8bb340bdf9de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:01.032283 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-12fe6366-3a33-4ed8-a8c8-8bb340bdf9de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:01.136149 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-12fe6366-3a33-4ed8-a8c8-8bb340bdf9de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 31389 microversion: 2.1 time: 0.118739 Jan 21 13:49:01.137110 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 160/332] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:01 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 31389 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:49:01.194501 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:01.205168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b12e196d-da46-4dde-9e1e-09f747cf04dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.338346 Jan 21 13:49:01.205843 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 173/333] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:00 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:01.359988 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:01.360930 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:01.368867 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:01.370297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:01.371528 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:01.372010 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:01.618743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:01.627300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5d66f283-15fa-47cd-a22f-ed1b9c60d956 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1505 microversion: 2.1 time: 0.271260 Jan 21 13:49:01.628194 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 161/334] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:01 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:01.728577 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-44edc2d6-2ddd-4a58-867c-a24e8d3d83cb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:01.731105 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-44edc2d6-2ddd-4a58-867c-a24e8d3d83cb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:01.738888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-44edc2d6-2ddd-4a58-867c-a24e8d3d83cb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:01.739673 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-44edc2d6-2ddd-4a58-867c-a24e8d3d83cb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:01.741407 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-44edc2d6-2ddd-4a58-867c-a24e8d3d83cb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:01.755452 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-44edc2d6-2ddd-4a58-867c-a24e8d3d83cb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:01.894431 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-44edc2d6-2ddd-4a58-867c-a24e8d3d83cb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 33139 microversion: 2.20 time: 0.170976 Jan 21 13:49:01.896232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 174/335] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:01 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 33139 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:02.147783 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4193c5e3-c78b-4333-9a67-caaa9b6bc18b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:02.148846 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4193c5e3-c78b-4333-9a67-caaa9b6bc18b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:02.158673 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4193c5e3-c78b-4333-9a67-caaa9b6bc18b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:02.159417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4193c5e3-c78b-4333-9a67-caaa9b6bc18b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:02.160434 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4193c5e3-c78b-4333-9a67-caaa9b6bc18b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:02.161129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4193c5e3-c78b-4333-9a67-caaa9b6bc18b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:02.223181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:02.224475 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:02.239743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:02.241414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:02.243731 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:02.245594 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:02.263100 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4193c5e3-c78b-4333-9a67-caaa9b6bc18b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 32447 microversion: 2.1 time: 0.119014 Jan 21 13:49:02.268216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 162/336] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:02 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 32447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:02.495298 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:02.506544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-098fa529-25ab-47fc-a380-1f10d917301c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.286855 Jan 21 13:49:02.507376 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 175/337] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:02 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:02.908498 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-adfff9fc-5800-4ffa-9914-277b4f657021 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:02.910821 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-adfff9fc-5800-4ffa-9914-277b4f657021 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:02.924285 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-5800-4ffa-9914-277b4f657021 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:02.926932 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-5800-4ffa-9914-277b4f657021 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:02.928009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-5800-4ffa-9914-277b4f657021 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:02.930417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-5800-4ffa-9914-277b4f657021 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:03.274857 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b9cda0a9-28bc-4b89-a1b5-d7572996f6b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:03.277290 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b9cda0a9-28bc-4b89-a1b5-d7572996f6b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:03.284245 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b9cda0a9-28bc-4b89-a1b5-d7572996f6b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:03.284989 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b9cda0a9-28bc-4b89-a1b5-d7572996f6b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:03.285961 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b9cda0a9-28bc-4b89-a1b5-d7572996f6b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:03.286604 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b9cda0a9-28bc-4b89-a1b5-d7572996f6b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:05.321910 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-adfff9fc-5800-4ffa-9914-277b4f657021 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 34596 microversion: 2.20 time: 2.417784 Jan 21 13:49:05.328668 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 163/338] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:02 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 34596 bytes in 2425 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:05.334594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:05.335848 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:05.343091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b9cda0a9-28bc-4b89-a1b5-d7572996f6b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 33754 microversion: 2.1 time: 2.071652 Jan 21 13:49:05.343741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 176/339] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:03 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 33754 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:49:05.354229 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:05.354870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:05.355705 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:05.356324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:05.508431 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:05.516722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-13bd6c3a-a079-4f47-8eec-47e13f6616da tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.186332 Jan 21 13:49:05.517538 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 164/340] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:05 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:06.303807 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c9c1f2d8-803b-413c-a2c8-f14b13c4c44b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb6d28b2-69cd-4571-841e-08090c4099cf"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:06.305390 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c9c1f2d8-803b-413c-a2c8-f14b13c4c44b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:06.319403 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9c1f2d8-803b-413c-a2c8-f14b13c4c44b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.319858 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9c1f2d8-803b-413c-a2c8-f14b13c4c44b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.320666 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9c1f2d8-803b-413c-a2c8-f14b13c4c44b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.324065 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9c1f2d8-803b-413c-a2c8-f14b13c4c44b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.336014 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-87e02137-4420-4daa-a4c0-f8b1e71501c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:06.337599 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-87e02137-4420-4daa-a4c0-f8b1e71501c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:06.348219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87e02137-4420-4daa-a4c0-f8b1e71501c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.356934 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87e02137-4420-4daa-a4c0-f8b1e71501c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.361722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87e02137-4420-4daa-a4c0-f8b1e71501c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.364272 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87e02137-4420-4daa-a4c0-f8b1e71501c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.527715 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-87e02137-4420-4daa-a4c0-f8b1e71501c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 35476 microversion: 2.20 time: 0.195655 Jan 21 13:49:06.533358 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 165/341] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:06 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 35476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:06.543758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7d7aa482-ff12-4475-b2b4-5af4afa12379 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:06.545033 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7d7aa482-ff12-4475-b2b4-5af4afa12379 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:06.557187 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d7aa482-ff12-4475-b2b4-5af4afa12379 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.557733 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d7aa482-ff12-4475-b2b4-5af4afa12379 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.569733 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d7aa482-ff12-4475-b2b4-5af4afa12379 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.571220 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d7aa482-ff12-4475-b2b4-5af4afa12379 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.714461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7d7aa482-ff12-4475-b2b4-5af4afa12379 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 34442 microversion: 2.1 time: 0.178884 Jan 21 13:49:06.715304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 166/342] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:06 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 34442 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:06.720575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:06.727682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:06.743835 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.744368 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.745508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:06.746097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:06.861734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c9c1f2d8-803b-413c-a2c8-f14b13c4c44b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.560753 Jan 21 13:49:06.868216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 177/343] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:49:06 2022] POST /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:06.916566 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:06.926689 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-581a2547-fae0-4285-9d17-aacf33a7ebc2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.210212 Jan 21 13:49:06.927321 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 167/344] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:06 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:07.542093 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f201c44c-9ce3-470d-b737-7ea89feed720 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:07.543299 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f201c44c-9ce3-470d-b737-7ea89feed720 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:07.549746 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f201c44c-9ce3-470d-b737-7ea89feed720 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:07.550341 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f201c44c-9ce3-470d-b737-7ea89feed720 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:07.551405 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f201c44c-9ce3-470d-b737-7ea89feed720 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:07.551940 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f201c44c-9ce3-470d-b737-7ea89feed720 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:07.726953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0e7d16fd-2324-4308-9d6f-b129512617d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:07.727415 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0e7d16fd-2324-4308-9d6f-b129512617d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:07.735132 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0e7d16fd-2324-4308-9d6f-b129512617d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:07.735837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0e7d16fd-2324-4308-9d6f-b129512617d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:07.736850 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0e7d16fd-2324-4308-9d6f-b129512617d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:07.737290 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0e7d16fd-2324-4308-9d6f-b129512617d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:09.700017 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0e7d16fd-2324-4308-9d6f-b129512617d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 36388 microversion: 2.1 time: 1.976541 Jan 21 13:49:09.704646 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 168/345] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:07 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 36388 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:09.706835 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:09.707523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:09.716864 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:09.717312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:09.718096 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:09.718527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:09.726544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f201c44c-9ce3-470d-b737-7ea89feed720 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 38028 microversion: 2.20 time: 2.189314 Jan 21 13:49:09.727680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 178/346] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:07 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 38028 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:09.921874 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:09.929476 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5e996159-3ad3-4196-9b44-dbfd3c3d32a2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.226414 Jan 21 13:49:09.930067 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 169/347] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:09 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:10.715084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e6fd9098-f884-45eb-9bde-bfff4d9d48cf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:10.722773 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e6fd9098-f884-45eb-9bde-bfff4d9d48cf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:10.731794 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6fd9098-f884-45eb-9bde-bfff4d9d48cf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:10.734571 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6fd9098-f884-45eb-9bde-bfff4d9d48cf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:10.743600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a8aa5834-5de7-4af1-95b3-97490fba8fd1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:10.745453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a8aa5834-5de7-4af1-95b3-97490fba8fd1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:10.749023 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6fd9098-f884-45eb-9bde-bfff4d9d48cf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:10.753100 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a8aa5834-5de7-4af1-95b3-97490fba8fd1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:10.753546 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a8aa5834-5de7-4af1-95b3-97490fba8fd1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:10.754335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a8aa5834-5de7-4af1-95b3-97490fba8fd1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:10.754766 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a8aa5834-5de7-4af1-95b3-97490fba8fd1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:10.760978 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6fd9098-f884-45eb-9bde-bfff4d9d48cf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:10.901130 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a8aa5834-5de7-4af1-95b3-97490fba8fd1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 38115 microversion: 2.20 time: 0.148684 Jan 21 13:49:10.901130 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 170/348] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:10 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 38115 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:49:10.912936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e6fd9098-f884-45eb-9bde-bfff4d9d48cf tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 36979 microversion: 2.1 time: 0.202803 Jan 21 13:49:10.915242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 179/349] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:10 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 36979 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:49:10.949006 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:10.949817 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:10.957445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:10.957988 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:10.958859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:10.959541 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:11.127021 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:11.135532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-226f3845-a4c1-4958-8d2c-8b6ce5f80217 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.191847 Jan 21 13:49:11.136736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 171/350] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:10 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:11.610045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ac39e8dc-6a5f-41f7-99c9-e1bedb1d8da0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Action: 'create', calling method: .version_select at 0x7f51bc12aaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-42876764"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:11.626123 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-ac39e8dc-6a5f-41f7-99c9-e1bedb1d8da0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Getting quotas for project cc3afc808f84460e9dce024a40c56a4c. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:49:11.630279 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-ac39e8dc-6a5f-41f7-99c9-e1bedb1d8da0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Getting quotas for user 57e653df84bc4f83beccfe6033469da5 and project cc3afc808f84460e9dce024a40c56a4c. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:49:11.784738 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-ac39e8dc-6a5f-41f7-99c9-e1bedb1d8da0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Getting quotas for project cc3afc808f84460e9dce024a40c56a4c. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:49:11.788389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-ac39e8dc-6a5f-41f7-99c9-e1bedb1d8da0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Getting quotas for user 57e653df84bc4f83beccfe6033469da5 and project cc3afc808f84460e9dce024a40c56a4c. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:49:11.802457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ac39e8dc-6a5f-41f7-99c9-e1bedb1d8da0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.196566 Jan 21 13:49:11.803053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 180/351] 10.222.0.84 () {60 vars in 1157 bytes} [Fri Jan 21 13:49:11 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:11.849400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-181029111", "imageRef": "921647f3-a8da-41e8-8e36-7e4cd401a88a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-42876764", "networks": [{"uuid": "26d3b52c-77bd-4f5d-962e-30057cef4db0"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:11.897835 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7d37b81f-1983-43a4-8489-82270b37df2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:11.898860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7d37b81f-1983-43a4-8489-82270b37df2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:11.899116 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] validate_networks() for [('26d3b52c-77bd-4f5d-962e-30057cef4db0', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:49:11.905913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d37b81f-1983-43a4-8489-82270b37df2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:11.906366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d37b81f-1983-43a4-8489-82270b37df2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:11.907409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d37b81f-1983-43a4-8489-82270b37df2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:11.907858 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d37b81f-1983-43a4-8489-82270b37df2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:12.260405 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:49:12.260859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:49:12.261356 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:49:12.261762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:49:12.262170 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:49:12.270711 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:12.271097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:12.271901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:12.272334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:12.288254 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Getting quotas for project cc3afc808f84460e9dce024a40c56a4c. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:49:12.292815 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Getting quotas for user 57e653df84bc4f83beccfe6033469da5 and project cc3afc808f84460e9dce024a40c56a4c. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:49:12.303621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:49:12.305876 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='921647f3-a8da-41e8-8e36-7e4cd401a88a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:49:12.350906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a673e5d6-1ebc-48bf-98b4-1363848b2b05 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505137 Jan 21 13:49:12.351777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 172/352] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:49:12.357315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d0131b95-b827-4d2b-a273-f67b1d88b888 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:12.358277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d0131b95-b827-4d2b-a273-f67b1d88b888 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:12.364061 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0131b95-b827-4d2b-a273-f67b1d88b888 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:12.364512 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0131b95-b827-4d2b-a273-f67b1d88b888 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:12.365321 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0131b95-b827-4d2b-a273-f67b1d88b888 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:12.365762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0131b95-b827-4d2b-a273-f67b1d88b888 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:13.880480 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d0131b95-b827-4d2b-a273-f67b1d88b888 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 38122 microversion: 2.1 time: 1.527447 Jan 21 13:49:13.881180 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 173/353] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:12 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 38122 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:13.887288 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:13.887980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:13.895854 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:13.896255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:13.896539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7d37b81f-1983-43a4-8489-82270b37df2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 200 len: 38256 microversion: 2.20 time: 2.002573 Jan 21 13:49:13.897189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:13.897697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:13.899314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 181/354] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:11 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 38256 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:49:13.907165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:13.908138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:13.915943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:13.916915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:13.917930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:13.918594 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:13.990907 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:14.000423 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-58c23383-fb61-4ec7-b58d-b20afd2a133b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1252 microversion: 2.1 time: 0.099457 Jan 21 13:49:14.000815 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 182/355] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:13 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1252 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:14.005498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-79389bee-3565-4651-b982-0f68e842ac04 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:14.006699 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-79389bee-3565-4651-b982-0f68e842ac04 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:14.014553 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-79389bee-3565-4651-b982-0f68e842ac04 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:14.015241 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-79389bee-3565-4651-b982-0f68e842ac04 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:14.016994 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-79389bee-3565-4651-b982-0f68e842ac04 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:14.017995 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-79389bee-3565-4651-b982-0f68e842ac04 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:14.050503 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-79389bee-3565-4651-b982-0f68e842ac04 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/ips" status: 200 len: 153 microversion: 2.20 time: 0.048354 Jan 21 13:49:14.051682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 183/356] 10.222.0.84 () {60 vars in 1288 bytes} [Fri Jan 21 13:49:14 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/ips => generated 153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:14.060708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:14.070551 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7b5b7ebd-6fa3-4630-a66b-8ab5a48e9a40 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.188196 Jan 21 13:49:14.072148 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 174/357] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:13 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:14.893679 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-900900d0-848c-4169-ae47-c77ca6abd64c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:14.894779 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-900900d0-848c-4169-ae47-c77ca6abd64c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:14.903756 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-900900d0-848c-4169-ae47-c77ca6abd64c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:14.904409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-900900d0-848c-4169-ae47-c77ca6abd64c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:14.905429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-900900d0-848c-4169-ae47-c77ca6abd64c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:14.905932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-900900d0-848c-4169-ae47-c77ca6abd64c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:15.019895 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:15.021534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:15.022040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-900900d0-848c-4169-ae47-c77ca6abd64c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 38125 microversion: 2.1 time: 0.131318 Jan 21 13:49:15.024539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 184/358] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:14 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 38125 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:15.044171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:15.044515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:15.045382 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:15.046184 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:15.093127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:15.093849 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:15.100801 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:15.101457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:15.102462 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:15.103069 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:15.137383 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:15.146080 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3f73c3a3-9eca-4b78-8b15-6d0253afda9d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1326 microversion: 2.1 time: 0.132848 Jan 21 13:49:15.148277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 175/359] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:15 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:15.362988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:15.371864 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-65ddfa78-cc95-4679-824c-ba3ebba4ee96 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.283928 Jan 21 13:49:15.373095 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 185/360] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:15 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:16.035641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-91d7e145-0005-4142-a658-ac4efeef271b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:16.036655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-91d7e145-0005-4142-a658-ac4efeef271b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:16.056744 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-91d7e145-0005-4142-a658-ac4efeef271b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.060644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-91d7e145-0005-4142-a658-ac4efeef271b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.061707 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-91d7e145-0005-4142-a658-ac4efeef271b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.062268 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-91d7e145-0005-4142-a658-ac4efeef271b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.165512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:16.166931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:16.188222 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.188713 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.194339 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.195528 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.336144 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:16.343822 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a4569c8f-5ee5-49f5-85e8-8740cf835074 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.182210 Jan 21 13:49:16.344564 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 186/361] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:16 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:16.390343 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:16.390955 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:16.397566 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.398031 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.398832 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.399650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.560923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:16.569451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9577e21d-380e-4385-a4e3-8aedc262e989 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.182762 Jan 21 13:49:16.570415 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 187/362] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:16 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:16.597390 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:16.597946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:16.604719 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.605168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.605948 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.606383 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.629704 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lazy-loading 'flavor' on Instance uuid 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:49:16.905465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-103df442-481b-460f-bfa9-386fa0dd6927 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 202 len: 0 microversion: 2.20 time: 0.311419 Jan 21 13:49:16.906252 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 188/363] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:49:16 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 21 13:49:16.914521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:16.915213 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:16.921549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.922001 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:16.922789 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:16.923226 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:17.069929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:17.080712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:17.082782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:17.084580 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2a091641-d610-44ae-9b1f-b93b62bf6d10 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.173767 Jan 21 13:49:17.085346 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 189/364] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:16 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:17.362696 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:17.364361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:17.377258 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:17.377862 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:17.378865 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:17.379594 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:17.541434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:17.549963 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a0025491-23c3-4cfa-a54b-05118eb71dce tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.193003 Jan 21 13:49:17.551231 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 190/365] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:17 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:17.586883 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:17.588284 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:17.595355 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:17.596058 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:17.596879 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:17.597315 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:17.805195 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:17.816318 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b680ab9a-a17c-4206-bbf4-e6040a821ed4 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.233021 Jan 21 13:49:17.817527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 191/366] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:17 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:18.105433 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:18.105958 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:18.112151 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:18.112626 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:18.113416 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:18.113853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:18.248692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:18.256406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:18.258048 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:18.259340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-144a6601-116f-4a07-844b-59781f07e655 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.158474 Jan 21 13:49:18.259897 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 192/367] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:18 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:18.567876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:18.569252 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:18.582425 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:18.582886 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:18.583701 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:18.584143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:18.808498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:18.816701 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-87a1f776-c908-4ee5-aad0-951fbabcfc1e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.252309 Jan 21 13:49:18.817409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 193/368] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:18 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:18.834351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:18.834964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:18.841759 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:18.842429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:18.843287 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:18.843900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:18.993320 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:19.001252 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c2666356-b80d-41e3-b2f4-b1b1501b50e1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.170460 Jan 21 13:49:19.001833 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 194/369] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:18 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:19.282369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:19.282895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:19.289779 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:19.290237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:19.291082 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:19.291683 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:19.435396 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:19.440397 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:19.441963 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:19.443137 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4c38c571-14e4-48f7-81da-4ad7e9186ff6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.165434 Jan 21 13:49:19.443915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 195/370] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:19 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:19.834401 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:19.835090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:19.841941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:19.842399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:19.843230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:19.843671 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:20.005993 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:20.015020 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8350eece-061d-4b0c-95e3-63b9e36273bb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.183498 Jan 21 13:49:20.016156 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 196/371] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:19 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:20.020498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:20.021136 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:20.028967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:20.029418 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:20.030486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:20.030923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:20.204929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:20.213728 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-719bd6d9-2fa3-45be-8c10-5e7d4c144a5b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.196721 Jan 21 13:49:20.214517 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 197/372] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:20 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:20.462218 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:20.463730 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:20.469787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:20.470206 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:20.470985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:20.471414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:20.621025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:20.632451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:20.634581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:20.636188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-322df09b-10aa-4d35-9066-0c962f9b64bc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.177619 Jan 21 13:49:20.637853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 198/373] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:20 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:21.033349 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:21.034077 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:21.041334 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:21.041884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:21.042738 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:21.043249 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:21.256009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:21.263858 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-be63b79d-7ee4-48a7-9dac-cdaeeb16993d tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.234212 Jan 21 13:49:21.264361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 199/374] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:21 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:21.269741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:21.270630 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:21.276920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:21.277700 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:21.278722 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:21.279360 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:21.460789 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:21.469129 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e49cca13-7e71-431d-b84f-4c1d546cf2c2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.202811 Jan 21 13:49:21.469702 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 200/375] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:21 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:21.659736 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:21.660746 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:21.667162 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:21.667705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:21.668582 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:21.669125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:21.856145 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:21.867958 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:21.870946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:21.872140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2e5004c8-a67c-40c9-90e0-fa8500780937 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.219847 Jan 21 13:49:21.881472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 201/376] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:21 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:22.281338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:22.282788 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:22.303100 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:22.304040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:22.305345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:22.305938 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:22.605929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:22.615697 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a50507e0-0906-4eed-a555-d32493f04bb2 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.338215 Jan 21 13:49:22.616651 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 202/377] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:22 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:22.637638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:22.638255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:22.644442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:22.648777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:22.648777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:22.648777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:22.915779 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:22.924663 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-82b0ea75-c461-4b45-9baa-3f96ebf7f98d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.306354 Jan 21 13:49:22.925704 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 203/378] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:22 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:22.939098 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:22.939730 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:22.960043 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:22.960498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:22.961330 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:22.961784 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:23.185434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:23.194979 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:23.198193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:23.199621 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bce45336-ea08-418c-ad51-b9506a5df077 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.270677 Jan 21 13:49:23.200356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 204/379] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:22 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:23.637160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:23.638012 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:23.649067 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:23.649628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:23.651067 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:23.651581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:23.965793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:23.975628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-078c5c4c-dd73-424f-967f-762c899bd01a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.342834 Jan 21 13:49:23.985757 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 205/380] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:23 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:23.990578 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:23.994979 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:24.010153 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:24.013244 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:24.016086 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:24.016857 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:24.312117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:24.329355 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8a5058c7-43e1-46fd-b637-7f595a8b3f89 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.333848 Jan 21 13:49:24.330487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 206/381] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:23 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:24.339721 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:24.350558 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:24.357398 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:24.358151 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:24.359426 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:24.360056 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:24.535320 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:24.547929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:24.549464 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:24.550662 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-43d1c0b3-4533-46a8-a797-78d755a296a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.215814 Jan 21 13:49:24.551559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 207/382] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:24 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:24.993202 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:24.995340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:25.004588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.005432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.006394 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.007021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.286527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:25.295150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4e17af41-2079-43cc-a5db-7a0ee9bc2ec9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.306432 Jan 21 13:49:25.295988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 208/383] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:24 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:25.349412 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:25.350410 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:25.369735 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.370399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.371620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.372472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.578202 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:25.586149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e5a89353-cbfe-47e5-b105-c61b012fda91 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.242140 Jan 21 13:49:25.587352 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 209/384] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:25 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:25.593421 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:25.594255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:25.601288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.601957 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.603637 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.604232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.612666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-91d7e145-0005-4142-a658-ac4efeef271b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 200 len: 38253 microversion: 2.1 time: 9.580690 Jan 21 13:49:25.620391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 176/385] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:16 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 38253 bytes in 9589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:49:25.626133 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-190cecff-8fc6-43c0-a671-60efbc8c344d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:25.627087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-190cecff-8fc6-43c0-a671-60efbc8c344d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:25.638364 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-190cecff-8fc6-43c0-a671-60efbc8c344d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.639245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-190cecff-8fc6-43c0-a671-60efbc8c344d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.640734 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-190cecff-8fc6-43c0-a671-60efbc8c344d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:25.641325 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-190cecff-8fc6-43c0-a671-60efbc8c344d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:25.687136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-190cecff-8fc6-43c0-a671-60efbc8c344d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/ips" status: 200 len: 145 microversion: 2.1 time: 0.065059 Jan 21 13:49:25.688130 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 177/386] 10.222.0.84 () {58 vars in 1247 bytes} [Fri Jan 21 13:49:25 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:26.273916 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:26.288421 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:26.292045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:26.294199 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-065836f7-b4ea-42fb-acce-8e21459000af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.705053 Jan 21 13:49:26.295020 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 210/387] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:25 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:26.312481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:26.313570 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:26.320760 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:26.321501 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:26.323254 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:26.323919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:26.573716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:26.585092 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0b37a129-aff7-424c-9fdc-680fc005adec tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.276711 Jan 21 13:49:26.585687 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 178/388] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:26 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:26.603256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:26.603996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:26.618941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:26.619686 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:26.620813 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:26.621414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:26.923387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:26.935635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4dfdd56c-d857-46d0-ba15-19f62e03676e tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1503 microversion: 2.1 time: 0.336123 Jan 21 13:49:26.943094 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 211/389] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:26 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1503 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:26.953753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eabadf66-a7ec-4822-8407-f0332509d2fd"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:26.955454 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:26.970572 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:26.971300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:26.972362 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:26.973031 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.023219 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-78da13c9-4d7b-4359-a96e-39183f942a01 req-071df4c2-6b4f-44ac-ba50-e8fc3611f324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db945-4044-472e-89aa-39c0d1c95ea1", "tag": "2496e76e-909a-4437-9b2f-e13165d82630"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:27.025809 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:27.025809 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:49:27.028810 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] HTTP exception thrown: Cannot 'attach_volume' instance 12549874-6848-4a56-b964-807011e2d9be while it is in vm_state rescued Jan 21 13:49:27.029408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Returning 409 to user: Cannot 'attach_volume' instance 12549874-6848-4a56-b964-807011e2d9be while it is in vm_state rescued {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:49:27.030488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9b77e752-b1e6-430e-b907-253daa9393fa tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.081036 Jan 21 13:49:27.035316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 179/390] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:49:26 2022] POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments => generated 152 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 21 13:49:27.047296 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-78da13c9-4d7b-4359-a96e-39183f942a01 req-071df4c2-6b4f-44ac-ba50-e8fc3611f324 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.047679 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b94e0080-bf31-4833-b70b-dacc59de1e73 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:27.048218 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-78da13c9-4d7b-4359-a96e-39183f942a01 req-071df4c2-6b4f-44ac-ba50-e8fc3611f324 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.053650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b94e0080-bf31-4833-b70b-dacc59de1e73 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:27.065518 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b94e0080-bf31-4833-b70b-dacc59de1e73 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.069325 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b94e0080-bf31-4833-b70b-dacc59de1e73 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.070396 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b94e0080-bf31-4833-b70b-dacc59de1e73 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.071026 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b94e0080-bf31-4833-b70b-dacc59de1e73 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.086112 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-78da13c9-4d7b-4359-a96e-39183f942a01 req-071df4c2-6b4f-44ac-ba50-e8fc3611f324 service nova] Creating event network-changed:2496e76e-909a-4437-9b2f-e13165d82630 for instance 701db945-4044-472e-89aa-39c0d1c95ea1 on hv-cinder-82016 Jan 21 13:49:27.106529 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-78da13c9-4d7b-4359-a96e-39183f942a01 req-071df4c2-6b4f-44ac-ba50-e8fc3611f324 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082903 Jan 21 13:49:27.110669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 212/391] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:49:27.189065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b94e0080-bf31-4833-b70b-dacc59de1e73 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action" status: 202 len: 0 microversion: 2.1 time: 0.152057 Jan 21 13:49:27.190515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 180/392] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:27 2022] POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:27.199184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:27.200223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:27.207295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.208180 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.214051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.214828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.316167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:27.316814 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:27.332054 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.334941 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.336251 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.336728 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.660153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:27.668987 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:27.671772 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:27.673237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-42f9ca74-9f47-4e5a-8d9b-4e2137b52e47 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.361542 Jan 21 13:49:27.687334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 181/393] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:27 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:27.692527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb6d28b2-69cd-4571-841e-08090c4099cf"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:27.695694 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:27.702762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.703636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.704707 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.705380 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.865786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] HTTP exception thrown: Invalid volume: volume bb6d28b2-69cd-4571-841e-08090c4099cf is already attached to instances: 4262414e-91b5-4f61-9b5c-c51380f5fc46 Jan 21 13:49:27.866400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Returning 400 to user: Invalid volume: volume bb6d28b2-69cd-4571-841e-08090c4099cf is already attached to instances: 4262414e-91b5-4f61-9b5c-c51380f5fc46 {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:49:27.867295 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-479cb0b6-0955-43ea-b686-d7d8a42e750f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178677 Jan 21 13:49:27.872940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 182/394] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:49:27 2022] POST /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments => generated 174 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:49:27.883383 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:27.888262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:27.910972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.911547 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.912479 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.913053 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.921495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:27.935237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-19b10b6b-47f8-42c3-b4ab-876d7a0152ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1511 microversion: 2.1 time: 0.740452 Jan 21 13:49:27.936052 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 213/395] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:27 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1511 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:27.981127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:27.981570 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:27.995108 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.995559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:27.996365 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:27.997736 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:28.202417 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lazy-loading 'services' on Instance uuid 4262414e-91b5-4f61-9b5c-c51380f5fc46 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:49:28.310461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:28.328323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-83687b4f-4954-484a-8ffa-01c42fe18e3c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.453621 Jan 21 13:49:28.328970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 183/396] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:27 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:28.425317 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0daf6942-9ad0-4a96-b4e1-1c8118430ede tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments/bb6d28b2-69cd-4571-841e-08090c4099cf" status: 202 len: 0 microversion: 2.1 time: 0.447552 Jan 21 13:49:28.434600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f07dbaaf-af63-4482-b4e1-6b14c4dc27b7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:28.435931 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f07dbaaf-af63-4482-b4e1-6b14c4dc27b7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:28.442440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 214/397] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:49:27 2022] DELETE /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments/bb6d28b2-69cd-4571-841e-08090c4099cf => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:28.447349 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f07dbaaf-af63-4482-b4e1-6b14c4dc27b7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:28.448050 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f07dbaaf-af63-4482-b4e1-6b14c4dc27b7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:28.450425 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f07dbaaf-af63-4482-b4e1-6b14c4dc27b7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:28.451980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f07dbaaf-af63-4482-b4e1-6b14c4dc27b7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:28.511902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f07dbaaf-af63-4482-b4e1-6b14c4dc27b7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080672 Jan 21 13:49:28.512844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 184/398] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:49:28 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:28.701946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:28.702658 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:28.720692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:28.721120 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:28.721932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:28.722371 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:28.825775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a9ab9114-b5ef-4112-8e00-9071476c41b6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fdfafee-4d84-47a3-b296-42e74e38eb2c"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:28.826934 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a9ab9114-b5ef-4112-8e00-9071476c41b6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:28.859523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9ab9114-b5ef-4112-8e00-9071476c41b6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:28.862034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9ab9114-b5ef-4112-8e00-9071476c41b6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:28.864987 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9ab9114-b5ef-4112-8e00-9071476c41b6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:28.865621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9ab9114-b5ef-4112-8e00-9071476c41b6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:29.325106 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:29.344205 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:29.352187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:29.355874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c63aad7c-d707-4a5c-9995-1be19c615c91 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.665507 Jan 21 13:49:29.373869 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 215/399] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:28 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:29.384914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:29.394976 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a9ab9114-b5ef-4112-8e00-9071476c41b6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.576988 Jan 21 13:49:29.396259 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:29.404143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:29.406718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:29.407760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:29.410490 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 185/400] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:49:28 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:29.411117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:29.423912 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:29.424990 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:29.452381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:29.454503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:29.455513 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:29.456169 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:29.754862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:29.766805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-de91ddf0-c9db-41ae-87b8-8346d60fbc07 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.351509 Jan 21 13:49:29.768927 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 186/401] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:29 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:29.778556 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a87d6bf6-1009-4c13-94f1-52c9e830d836 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:29.780903 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a87d6bf6-1009-4c13-94f1-52c9e830d836 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:29.788471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a87d6bf6-1009-4c13-94f1-52c9e830d836 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:29.789153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a87d6bf6-1009-4c13-94f1-52c9e830d836 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:29.790343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a87d6bf6-1009-4c13-94f1-52c9e830d836 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:29.790696 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a87d6bf6-1009-4c13-94f1-52c9e830d836 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:29.831028 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:29.840646 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a87d6bf6-1009-4c13-94f1-52c9e830d836 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070224 Jan 21 13:49:29.841570 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 187/402] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:49:29 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:49:29.845472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-41d42bd8-64e1-4008-9e3b-dafebecdc43d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1511 microversion: 2.1 time: 0.470182 Jan 21 13:49:29.852579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 216/403] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:29 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:30.091189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-546316933", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "d3bfe002-b112-41ad-8d5b-fc9e48025c33"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:30.152804 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] validate_networks() for [('d3bfe002-b112-41ad-8d5b-fc9e48025c33', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:49:30.379205 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:30.384851 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:30.392706 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.393489 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:30.395599 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.398231 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:30.585305 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:49:30.585788 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:49:30.586218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:49:30.586626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:49:30.587530 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:49:30.615243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.615689 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:30.616500 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.620229 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:30.646052 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:49:30.646217 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:30.656644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Getting quotas for user 8ef601f05ed04634bf325e21efbea29d and project e0bba285c3584d64b257d0800a59f0a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:49:30.657997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:30.659698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:30.660757 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5e1c7dbc-9ba6-4642-bcd8-c77486ca2138 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.285250 Jan 21 13:49:30.661261 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 217/404] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:30 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:30.678993 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:49:30.683946 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:49:30.778705 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-89faa9f0-3e0b-4f4f-8509-571a38958573 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693825 Jan 21 13:49:30.780493 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 188/405] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:49:30.783518 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:30.784139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:30.791153 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.791846 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:30.792842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.793439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:30.806424 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-338ac240-9e3d-46dc-8ae4-0b95947e806c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:30.827612 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-338ac240-9e3d-46dc-8ae4-0b95947e806c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:30.954439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-338ac240-9e3d-46dc-8ae4-0b95947e806c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:30.967924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-338ac240-9e3d-46dc-8ae4-0b95947e806c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1217 microversion: 2.1 time: 0.176953 Jan 21 13:49:30.969996 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 189/406] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:30 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:30.976887 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:30.978110 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:30.986650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.987511 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:30.988859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:30.989572 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:31.234020 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:31.244215 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e732a992-4c3f-4a98-9438-fbe68324d749 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.463353 Jan 21 13:49:31.248006 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 218/407] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:30 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:31.350760 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:31.360351 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a1dfb98d-0ac2-48cb-8c71-e79c75413177 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1511 microversion: 2.1 time: 0.389058 Jan 21 13:49:31.360995 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 190/408] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:30 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:31.678690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:31.679936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:31.687776 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:31.688638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:31.689595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:31.690189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:31.898551 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:31.916598 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:31.918346 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:31.919651 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9ac437d1-0f6b-4436-9688-0b431152bfd4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.245331 Jan 21 13:49:31.920666 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 219/409] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:31 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:31.987074 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:31.987780 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:31.994186 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:31.994925 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:31.996667 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:31.997420 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:32.086462 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:32.098074 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ec52ceef-526b-406e-86d0-37474eb0d698 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1269 microversion: 2.1 time: 0.115004 Jan 21 13:49:32.098816 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 191/410] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:31 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1269 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:32.263288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:32.264298 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:32.272358 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:32.272853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:32.273667 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:32.277730 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:32.378825 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:32.379767 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:32.395734 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:32.396365 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:32.397241 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:32.397674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:32.632703 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:32.641811 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d76dc1ca-922b-4374-81d0-022e7fb6a50e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.382180 Jan 21 13:49:32.643538 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 220/411] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:32 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:32.805324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:32.828760 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-038fdfa0-f4c4-46d3-a453-88fb7a68a938 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1517 microversion: 2.1 time: 0.453906 Jan 21 13:49:32.841461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 192/412] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:32 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:32.938828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:32.939443 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:32.947328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:32.947777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:32.950911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:32.951631 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:33.116929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:33.118288 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:33.130936 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:33.132553 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:33.133643 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:33.135961 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:33.289327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:33.318173 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-42ac566d-f55d-486e-af6d-34ef5d8adc3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1275 microversion: 2.1 time: 0.206317 Jan 21 13:49:33.319819 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 193/413] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:33 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:33.661029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:33.662208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:33.674348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:33.675273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:33.676413 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:33.680439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:33.792565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:33.801407 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:33.809364 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:33.810851 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-abe2ec86-e831-40dc-8a32-743ccbade322 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.876142 Jan 21 13:49:33.813246 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 221/414] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:32 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:34.044044 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:34.058722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0ba20677-2794-461f-9907-bded5e04e3b1 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.401625 Jan 21 13:49:34.069611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 194/415] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:33 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:34.340001 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:34.340650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:34.353947 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:34.354813 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:34.356329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:34.356997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:34.569384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:34.570280 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:34.584092 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:34.589566 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:34.591255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:34.591722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:34.898760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:34.927382 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-39cd702b-495b-469b-8847-6b03d63ecb40 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 0.586555 Jan 21 13:49:34.935552 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 222/416] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:34 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:34.949300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:34.949928 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:34.972295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:34.975621 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:34.979860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:34.981497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:35.545450 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:35.567682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:35.569695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:35.583881 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f412a185-0530-403b-afc6-82d87aa9f46f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.646882 Jan 21 13:49:35.585420 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 223/417] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:34 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:35.594972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:35.596039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:35.604207 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:35.605046 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:35.606399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:35.607021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:35.763146 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:35.786128 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8d56b375-ab47-45ae-af6c-e23e34aed3dd tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1517 microversion: 2.1 time: 1.217390 Jan 21 13:49:35.788900 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 195/418] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:34 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1517 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:35.808666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b2b0d609-379f-474c-89f0-bb5df6b1b3b2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d267c86-b905-4ae0-ab9a-fe83abb19bd7"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:35.809936 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b2b0d609-379f-474c-89f0-bb5df6b1b3b2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:35.825361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b2b0d609-379f-474c-89f0-bb5df6b1b3b2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:35.826573 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b2b0d609-379f-474c-89f0-bb5df6b1b3b2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:35.827571 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b2b0d609-379f-474c-89f0-bb5df6b1b3b2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:35.828365 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b2b0d609-379f-474c-89f0-bb5df6b1b3b2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:36.167489 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:36.176183 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e9050e19-7b60-4137-9fe6-0be9f829e59a tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.589322 Jan 21 13:49:36.184367 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 224/419] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:35 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:36.204358 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:36.205022 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:36.232114 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:36.234688 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:36.240811 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:36.243732 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:36.479406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b2b0d609-379f-474c-89f0-bb5df6b1b3b2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.677093 Jan 21 13:49:36.480930 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 196/420] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:49:35 2022] POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments => generated 194 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:36.498586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-599700f7-ce34-4907-af0e-3e8e2f532381 req-93eaa9e1-c4d8-4adb-ae45-63b940a2ce14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f688f4e-9f41-43fb-aacc-58a71f34e07b", "tag": "44df63fb-31a8-41f0-9f36-5eb26e076375"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:36.516031 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:36.516031 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:49:36.538433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-599700f7-ce34-4907-af0e-3e8e2f532381 req-93eaa9e1-c4d8-4adb-ae45-63b940a2ce14 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:36.539474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-599700f7-ce34-4907-af0e-3e8e2f532381 req-93eaa9e1-c4d8-4adb-ae45-63b940a2ce14 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:36.554136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-599700f7-ce34-4907-af0e-3e8e2f532381 req-93eaa9e1-c4d8-4adb-ae45-63b940a2ce14 service nova] Creating event network-changed:44df63fb-31a8-41f0-9f36-5eb26e076375 for instance 6f688f4e-9f41-43fb-aacc-58a71f34e07b on hv-cinder-82016 Jan 21 13:49:36.560849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-599700f7-ce34-4907-af0e-3e8e2f532381 req-93eaa9e1-c4d8-4adb-ae45-63b940a2ce14 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078182 Jan 21 13:49:36.561613 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 197/421] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:36.570783 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-2c90db21-f588-4691-94bd-07fb4a3b64d5 req-6faee01e-af11-4b7f-b3aa-cb6cfdacc768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701db945-4044-472e-89aa-39c0d1c95ea1", "name": "network-vif-plugged", "status": "completed", "tag": "2496e76e-909a-4437-9b2f-e13165d82630"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:36.573474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:36.573474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:49:36.585405 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-2c90db21-f588-4691-94bd-07fb4a3b64d5 req-6faee01e-af11-4b7f-b3aa-cb6cfdacc768 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:36.586087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-2c90db21-f588-4691-94bd-07fb4a3b64d5 req-6faee01e-af11-4b7f-b3aa-cb6cfdacc768 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:36.603226 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-2c90db21-f588-4691-94bd-07fb4a3b64d5 req-6faee01e-af11-4b7f-b3aa-cb6cfdacc768 service nova] Creating event network-vif-plugged:2496e76e-909a-4437-9b2f-e13165d82630 for instance 701db945-4044-472e-89aa-39c0d1c95ea1 on hv-cinder-82016 Jan 21 13:49:36.617242 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-2c90db21-f588-4691-94bd-07fb4a3b64d5 req-6faee01e-af11-4b7f-b3aa-cb6cfdacc768 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050238 Jan 21 13:49:36.626429 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 198/422] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:36.649841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:36.652187 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:36.673619 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:36.674287 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:36.675580 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:36.676387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:37.196956 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:37.217946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-dbd22829-e0fa-465c-986d-fd7c4450a96d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 1.032210 Jan 21 13:49:37.220405 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 225/423] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:36 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:37.234686 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:37.235694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:37.240028 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:37.245871 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:37.246713 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:37.247680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:37.248366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:37.251107 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:37.258629 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:37.266519 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-cf628237-0502-4d15-8ed6-922894de435a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.638542 Jan 21 13:49:37.277239 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 199/424] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:36 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:37.415266 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6b2e0e4b-0bba-42b1-a00f-58dc9e9a1435 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:37.423560 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6b2e0e4b-0bba-42b1-a00f-58dc9e9a1435 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:37.428636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6b2e0e4b-0bba-42b1-a00f-58dc9e9a1435 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:37.567203 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6b2e0e4b-0bba-42b1-a00f-58dc9e9a1435 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Going to try to stop instance {{(pid=122813) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 21 13:49:37.633666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6b2e0e4b-0bba-42b1-a00f-58dc9e9a1435 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 202 len: 0 microversion: 2.1 time: 0.220885 Jan 21 13:49:37.635081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 200/425] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:37 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:49:37.647095 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:37.647814 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:37.657984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:37.658451 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:37.659754 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:37.660391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:37.748143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:37.756381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c69c43c3-e6bd-44a6-9b7b-deec29ffdcd9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.534392 Jan 21 13:49:37.758130 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 226/426] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:37 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:38.236799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:38.238116 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:38.248645 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:38.249337 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:38.250325 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:38.252383 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:38.278810 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:38.288303 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-240addee-2a86-4cc7-96c3-20be92c833f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.647903 Jan 21 13:49:38.292997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 201/427] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:37 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:38.301175 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:38.304240 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:38.319771 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:38.324534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:38.325857 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:38.326645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:38.613135 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:38.623194 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:38.625222 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:38.626417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-23c35b4b-ea65-4c98-b98e-663a3dff8b97 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.331939 Jan 21 13:49:38.626985 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 202/428] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:38 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:38.667972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:38.675874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d6de860f-cec1-4b9b-8c0e-87c7abfe95f6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 0.442929 Jan 21 13:49:38.676476 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 227/429] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:38 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:38.776888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:38.777549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:38.785449 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:38.785899 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:38.787051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:38.787493 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:38.890827 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3047a592-048e-44e5-92ae-96812f399aa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Action: 'create', calling method: .version_select at 0x7f51b6eb4430>, body: {"keypair": {"name": "tempest-TestShelveInstance-286078649"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:38.905837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-3047a592-048e-44e5-92ae-96812f399aa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Getting quotas for project 160416387af942969baffb4cbd2e83bf. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:49:38.910784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-3047a592-048e-44e5-92ae-96812f399aa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Getting quotas for user 16130424abc7467584acb6f15dbf544d and project 160416387af942969baffb4cbd2e83bf. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:49:38.934909 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:38.942286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-54201d6c-cfb5-4e0b-b662-bf289b06a4a0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1356 microversion: 2.1 time: 0.170286 Jan 21 13:49:38.942964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 228/430] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:38 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:39.115902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-3047a592-048e-44e5-92ae-96812f399aa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Getting quotas for project 160416387af942969baffb4cbd2e83bf. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:49:39.120554 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-3047a592-048e-44e5-92ae-96812f399aa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Getting quotas for user 16130424abc7467584acb6f15dbf544d and project 160416387af942969baffb4cbd2e83bf. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:49:39.136975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3047a592-048e-44e5-92ae-96812f399aa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.451253 Jan 21 13:49:39.137847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 203/431] 10.222.0.84 () {60 vars in 1157 bytes} [Fri Jan 21 13:49:38 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:39.310146 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:39.310870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:39.317165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.317504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:39.318282 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.318718 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:39.503298 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:39.512749 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-97ff3048-e497-4d43-bbc5-581541d80472 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.206588 Jan 21 13:49:39.513362 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 229/432] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:39 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:39.646486 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:39.647409 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:39.657495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.659453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:39.660507 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.661678 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:39.693429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:39.694286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:39.704551 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.705280 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:39.706267 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.706685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:39.877007 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:39.890115 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:39.895600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:39.897401 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8be02dca-580f-4c63-9b37-8883cb38b522 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.255566 Jan 21 13:49:39.898415 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 204/433] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:39 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:39.948636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:39.958876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3afb0910-30b5-4924-8ec6-8f5a087cb467 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 0.268898 Jan 21 13:49:39.960360 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 230/434] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:39 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:39.960474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:39.961287 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:39.969037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.969735 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:39.970716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:39.971217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.207212 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:40.215624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f57124ab-88ed-4bb1-ae23-598aaae038c0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1545 microversion: 2.1 time: 0.259315 Jan 21 13:49:40.216305 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 205/435] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:39 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1545 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:40.232743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:40.233576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:40.240740 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.241192 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.242160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.242751 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.436411 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:40.449222 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ff9d2b11-1692-419e-8231-762249e0c6dd tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1545 microversion: 2.1 time: 0.220169 Jan 21 13:49:40.454552 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 231/436] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:40 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1545 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:40.471655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:40.476333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:40.476333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:49:40.481860 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:40.485589 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Searching by: {'deleted': False, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c'} {{(pid=122813) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 21 13:49:40.513977 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.515278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.516934 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.517542 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.532459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:40.533216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:40.541897 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.543284 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.544245 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.544930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.664016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.multi_cell_list [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122813) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 21 13:49:40.787694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:40.797004 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-46a7038b-4625-4b6c-bf90-c566af7a9296 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.268785 Jan 21 13:49:40.800885 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 232/437] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:40 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:40.847309 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-68a4507d-7f2d-4e9c-b8fe-1ee0b656a38b tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.380312 Jan 21 13:49:40.848337 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 206/438] 10.222.0.84 () {58 vars in 1124 bytes} [Fri Jan 21 13:49:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:40.858049 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:40.859262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:40.866428 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.867170 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.868798 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.869449 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.917675 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:40.918825 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:40.927485 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.931406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:40.937478 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:40.938119 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:41.060936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:41.071329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-aa5a76e2-d2b5-4a0d-af67-08a2d4e04b87 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1545 microversion: 2.1 time: 0.216768 Jan 21 13:49:41.074149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 233/439] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:40 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1545 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:41.079642 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:41.080547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:41.092097 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:41.096492 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:41.100802 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:41.101887 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:41.205025 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:41.216956 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:41.218508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:41.222083 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-51e4bc71-6e90-41cc-aeac-da86e7388fc4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.308369 Jan 21 13:49:41.235341 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 207/440] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:40 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:41.329734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:41.351901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4eef7e28-e203-437f-bea1-859979a723e4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 0.275545 Jan 21 13:49:41.353101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 234/441] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:41 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:41.817896 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:41.819045 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:41.826341 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:41.826786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:41.827609 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:41.828108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:42.054503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:42.063286 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-daf6ce94-ce3f-4ec6-9317-931bfef1c9b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.249179 Jan 21 13:49:42.063865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 208/442] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:41 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:42.247963 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:42.248761 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:42.256189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:42.256797 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:42.257650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:42.258507 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:42.370648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:42.372049 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:42.383210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:42.383952 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:42.384953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:42.385562 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:42.412224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:42.429828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:42.431593 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:42.433025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-472beffe-8632-498a-b144-6cde6ff19c7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.188990 Jan 21 13:49:42.434080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 235/443] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:42 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:42.558494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:42.566278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-930ffa30-132a-4281-9c43-cb228c7fc279 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 0.199444 Jan 21 13:49:42.567292 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 209/444] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:42 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:42.764580 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9dee4407-16e8-4034-b733-1653cd6a80c4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1a45e5a-471d-43e2-857d-1ea312728fb9"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:42.765602 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9dee4407-16e8-4034-b733-1653cd6a80c4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:42.771791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dee4407-16e8-4034-b733-1653cd6a80c4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:42.772192 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dee4407-16e8-4034-b733-1653cd6a80c4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:42.773109 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dee4407-16e8-4034-b733-1653cd6a80c4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:42.773913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dee4407-16e8-4034-b733-1653cd6a80c4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.059799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9dee4407-16e8-4034-b733-1653cd6a80c4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298888 Jan 21 13:49:43.060405 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 236/445] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:49:42 2022] POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:49:43.082208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:43.082801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:43.090680 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:43.091147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.092099 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:43.092447 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.229373 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:43.239335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-36198cf0-5ded-4afd-8002-4cd4fe033996 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.160542 Jan 21 13:49:43.240110 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 210/446] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:43 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:43.453747 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:43.454612 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:43.461048 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:43.461555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.462819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:43.463281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.543185 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-2b003444-5a62-48a1-8b7d-bfa683b8c53a req-cee0dc7b-ebd4-48cb-91c0-74cb9a678273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f688f4e-9f41-43fb-aacc-58a71f34e07b", "name": "network-vif-plugged", "status": "completed", "tag": "44df63fb-31a8-41f0-9f36-5eb26e076375"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:43.544724 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:43.544724 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:49:43.569168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-2b003444-5a62-48a1-8b7d-bfa683b8c53a req-cee0dc7b-ebd4-48cb-91c0-74cb9a678273 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:43.570246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-2b003444-5a62-48a1-8b7d-bfa683b8c53a req-cee0dc7b-ebd4-48cb-91c0-74cb9a678273 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.594266 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-2b003444-5a62-48a1-8b7d-bfa683b8c53a req-cee0dc7b-ebd4-48cb-91c0-74cb9a678273 service nova] Creating event network-vif-plugged:44df63fb-31a8-41f0-9f36-5eb26e076375 for instance 6f688f4e-9f41-43fb-aacc-58a71f34e07b on hv-cinder-82016 Jan 21 13:49:43.606777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-2b003444-5a62-48a1-8b7d-bfa683b8c53a req-cee0dc7b-ebd4-48cb-91c0-74cb9a678273 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068861 Jan 21 13:49:43.607663 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 211/447] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:49:43.614984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:43.617131 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:43.626534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:43.633976 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.634235 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:43.635523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:43.636116 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:43.646410 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:43.648870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:43.651398 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d7353ec6-4a02-490a-95cf-61649daf7894 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.202971 Jan 21 13:49:43.652477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 237/448] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:43 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:43.837782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:43.845111 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fecf726d-3ae3-40fe-982a-1719cb223215 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 0.236027 Jan 21 13:49:43.846040 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 212/449] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:43 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:44.258077 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:44.259184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:44.265434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.265894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.266687 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.267125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.421954 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:44.429771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b424b57e-dc62-4ccc-8632-fc8b100ad2dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.175513 Jan 21 13:49:44.430512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 238/450] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:44 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:44.673276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:44.673276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:44.676641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.677215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.678357 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.678892 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.684338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:44.685440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:44.694342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.694924 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.696450 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.696932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.721168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lazy-loading 'flavor' on Instance uuid 12549874-6848-4a56-b964-807011e2d9be {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:49:44.863902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-515c28c1-d3df-4072-a111-8f8de4101037 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action" status: 200 len: 32 microversion: 2.1 time: 0.184388 Jan 21 13:49:44.869796 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 239/451] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:44 2022] POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:49:44.875176 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:44.876091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:44.880042 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:44.889453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:44.891273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:44.892422 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.892708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fb515964-58ad-441b-83c8-b0ea2251aa5d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.227416 Jan 21 13:49:44.892966 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.893679 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 213/452] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:44 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:44.894854 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.897833 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.898647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:44.899860 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:44.905943 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.906621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:44.907572 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:44.908002 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:45.062620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:45.071882 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b049f39a-8f42-4dd6-92da-e3c2d1d0e2ed tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.175337 Jan 21 13:49:45.072649 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 214/453] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:44 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:45.164059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:45.175212 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5e77fea8-beac-4cc6-a1eb-d3de42fd1aaf tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1317 microversion: 2.1 time: 0.303989 Jan 21 13:49:45.176075 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 240/454] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:44 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:45.447647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:45.448258 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:45.454273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:45.454772 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:45.455624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:45.456145 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:45.623712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:45.633010 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-909a3162-c97b-493e-9e7e-e8037c4eabf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.189437 Jan 21 13:49:45.634479 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 215/455] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:45 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:45.912729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:45.913345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:45.920225 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:45.920707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:45.921702 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:45.922143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:46.059664 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:46.067514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:46.069194 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:46.070590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-077d2090-3437-4982-9559-dc46c4b74527 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.161904 Jan 21 13:49:46.072568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 241/456] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:45 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:46.091070 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:46.091806 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:46.099652 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:46.100162 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:46.100985 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:46.101433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:46.193838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:46.194650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:46.201872 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:46.202328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:46.203124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:46.203787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:46.241671 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:46.251335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d0f36e06-9124-472c-b6da-9d5219f8c7b5 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.165252 Jan 21 13:49:46.251919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 216/457] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:46 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:46.369416 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:46.376593 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b467a104-fcf8-4477-9456-9463848178fb tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1507 microversion: 2.1 time: 0.187159 Jan 21 13:49:46.377186 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 242/458] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:46 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:46.651825 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:46.652689 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:46.658960 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:46.659495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:46.660427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:46.660904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:46.799343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:46.807629 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5a04595d-b892-407a-a3f6-3979e2e00356 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.160179 Jan 21 13:49:46.808196 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 217/459] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:46 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:47.092117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:47.093189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:47.101277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.101745 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.102663 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.103142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.238339 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:47.246802 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:47.248302 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:47.249471 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b59cc6ca-60d8-466a-ae80-44683becff12 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.162473 Jan 21 13:49:47.250114 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 243/460] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:47 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:47.269311 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:47.269918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:47.276951 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.277404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.278200 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.278640 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.413661 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:47.422335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d6d8ebf4-df97-48f5-afa0-b6b8963a761f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.156738 Jan 21 13:49:47.422908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 218/461] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:47 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:47.710940 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-975a8002-20d7-4bba-85f0-018537f82758 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "472f64d0-ade8-4acd-a02a-dcb69bec5a8e"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:47.712316 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-975a8002-20d7-4bba-85f0-018537f82758 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:47.719539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975a8002-20d7-4bba-85f0-018537f82758 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.719996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975a8002-20d7-4bba-85f0-018537f82758 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.720824 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975a8002-20d7-4bba-85f0-018537f82758 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.721266 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-975a8002-20d7-4bba-85f0-018537f82758 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.825357 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:47.826081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:47.831855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.832302 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.833210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:47.833843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:47.984278 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-975a8002-20d7-4bba-85f0-018537f82758 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "POST /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276969 Jan 21 13:49:47.985235 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 244/462] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:49:47 2022] POST /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:47.993217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:48.017954 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-797e6a70-4eb8-450e-8b82-9ab8152a70d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.196508 Jan 21 13:49:48.019636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 219/463] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:47 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:48.269167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:48.269885 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:48.276474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:48.276956 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:48.277737 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:48.278172 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:48.418368 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:48.426544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:48.428054 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:48.429236 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4cd79955-584c-404a-9e13-30f9319cd578 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.164632 Jan 21 13:49:48.429808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 245/464] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:48 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:48.438880 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:48.439495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:48.445822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:48.446280 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:48.447055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:48.447562 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:48.576534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:48.584055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c636bf48-9c73-4b7c-a4c7-cfb4054a0f33 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.148722 Jan 21 13:49:48.584638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 220/465] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:48 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:49.038809 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:49.039411 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:49.045721 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:49.046167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:49.046932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:49.047364 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:49.180581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:49.189536 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de7b4061-bf29-4653-9e5a-9c1931ba3fda tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.154605 Jan 21 13:49:49.190205 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 246/466] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:49 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:49.447198 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:49.447889 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:49.455390 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:49.455924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:49.456865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:49.457615 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:49.597363 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:49.601793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:49.602577 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:49.606844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:49.608559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:49.609801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-021d31d0-3d60-477b-be15-716b8487de08 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.166435 Jan 21 13:49:49.610366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 221/467] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:49 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:49.610476 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:49.611009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:49.611935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:49.612377 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:49.746769 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:49.755448 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8d0b4bff-4713-47f3-bea6-c89cf14bd3dc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.157166 Jan 21 13:49:49.756046 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 247/468] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:49 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:50.208776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:50.209421 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:50.215336 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:50.215785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:50.216563 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:50.217029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:50.351781 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:50.360644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7d58e5d4-445c-496f-b8e8-6d3274d45bad tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.155571 Jan 21 13:49:50.361229 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 222/469] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:50 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:50.628869 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:50.629591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:50.635853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:50.636293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:50.637262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:50.637697 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:50.773746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:50.774912 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:50.782436 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:50.783383 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:50.784204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:50.784677 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:50.923826 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:50.932522 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fe6e707d-be63-400d-ae53-cedd673a4cf0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.162400 Jan 21 13:49:50.933344 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 223/470] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:50 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:50.991881 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:51.000061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:51.001578 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:51.002715 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5a741c13-3783-4a7f-b936-f80cdf3ffe57 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.377719 Jan 21 13:49:51.003281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 248/471] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:50 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:51.377946 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:51.378615 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:51.384669 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:51.385123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:51.385903 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:51.386343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:51.525290 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:51.533579 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5f144323-4486-4d6d-a24d-fb46578eac44 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.159189 Jan 21 13:49:51.533987 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 224/472] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:51 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:51.675096 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:51.675707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:51.682109 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:51.682550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:51.683329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:51.683843 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:51.813793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:51.821416 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-11b78072-78e0-4412-b1d5-cba95d8f6279 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1591 microversion: 2.1 time: 0.149984 Jan 21 13:49:51.821986 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 249/473] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:51 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1591 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:51.949710 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:51.951011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:51.957500 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:51.957953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:51.958726 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:51.959430 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:52.021511 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:52.022124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:52.028863 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:52.029316 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:52.030596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:52.031032 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:52.104853 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:52.113404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-46a6ea0a-80cd-4715-b910-4bc5c19ee152 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.167255 Jan 21 13:49:52.113983 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 225/474] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:51 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:52.241053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:52.249842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:52.251654 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:52.253019 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-154581a8-daa3-4fa6-951c-f96207c3d659 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1745 microversion: 2.20 time: 0.235222 Jan 21 13:49:52.253788 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 250/475] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:52 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1745 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:52.551129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:52.551739 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:52.557667 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:52.558142 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:52.560065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:52.560543 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:52.703205 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:52.711515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1635bd19-4aea-4ed9-8742-933085ee35de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.163960 Jan 21 13:49:52.712096 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 226/476] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:52 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:53.131069 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:53.132487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:53.139544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:53.139997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:53.140838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:53.141283 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:53.272389 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:53.273034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:53.282766 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:53.285116 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:53.285953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:53.286536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:53.405406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:53.414125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-62635add-ce48-4104-a226-148dacf53ab7 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.286797 Jan 21 13:49:53.414689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 251/477] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:53 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:53.430272 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:53.446945 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:53.448955 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:53.450634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f64dc5a1-7d29-4117-a54c-650eea862e74 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1745 microversion: 2.20 time: 0.182025 Jan 21 13:49:53.461538 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 227/478] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:53 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:53.730078 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:53.730694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:53.736509 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:53.737165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:53.737951 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:53.738391 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:53.944729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:53.954141 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5ea23320-cbe9-4b3e-97d7-783bea3f23ba tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.227734 Jan 21 13:49:53.960847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-f5246fc8-45b6-40a7-a108-a84c1407df4a req-fe35e286-0206-4b57-b938-c91a4ef8eb25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db945-4044-472e-89aa-39c0d1c95ea1", "tag": "2496e76e-909a-4437-9b2f-e13165d82630"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:53.961674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:53.961674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:49:53.966849 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 252/479] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:53 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:53.975408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-f5246fc8-45b6-40a7-a108-a84c1407df4a req-fe35e286-0206-4b57-b938-c91a4ef8eb25 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:53.975408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-f5246fc8-45b6-40a7-a108-a84c1407df4a req-fe35e286-0206-4b57-b938-c91a4ef8eb25 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:54.000577 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-f5246fc8-45b6-40a7-a108-a84c1407df4a req-fe35e286-0206-4b57-b938-c91a4ef8eb25 service nova] Creating event network-changed:2496e76e-909a-4437-9b2f-e13165d82630 for instance 701db945-4044-472e-89aa-39c0d1c95ea1 on hv-cinder-82016 Jan 21 13:49:54.013335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-f5246fc8-45b6-40a7-a108-a84c1407df4a req-fe35e286-0206-4b57-b938-c91a4ef8eb25 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054522 Jan 21 13:49:54.013335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 228/480] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:49:54.430956 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:54.431557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:54.438863 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:54.439765 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:54.440791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:54.441449 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:54.469885 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:54.471271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:54.493138 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:54.493906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:54.494933 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:54.495529 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:54.698579 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:54.712312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:54.715166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:54.716553 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-94a269cf-8d1e-40d8-a939-cf472bc968f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1745 microversion: 2.20 time: 0.250672 Jan 21 13:49:54.727290 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 229/481] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:54 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1745 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:54.840804 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:54.850005 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9f98aef1-d978-4a39-9838-25010a9ec9d1 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.422588 Jan 21 13:49:54.850676 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 253/482] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:54 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:54.972787 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:54.973617 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:54.980620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:54.981121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:54.981915 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:54.982388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.233866 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:55.246227 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f12e43d0-9db6-4c61-bd6d-350499dbb4e3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.277069 Jan 21 13:49:55.246657 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 230/483] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:54 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:55.361534 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-792320631"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:55.362332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:55.368584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.369117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.369997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.370526 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.515628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.network.security_group_api [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Adding security group 87f9b4f1-f89d-4d54-a837-b3428966565d to port 2496e76e-909a-4437-9b2f-e13165d82630 Jan 21 13:49:55.591424 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-5095b244-56bb-4703-81ec-0bc9e8b42eae req-a335c9eb-e4f8-4ffa-94d6-e360d578f101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade", "name": "network-vif-plugged", "status": "completed", "tag": "13e896be-af8b-4c5b-b2fe-cd245c3385d1"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:55.593039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:55.593039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:49:55.600348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-5095b244-56bb-4703-81ec-0bc9e8b42eae req-a335c9eb-e4f8-4ffa-94d6-e360d578f101 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.601050 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-5095b244-56bb-4703-81ec-0bc9e8b42eae req-a335c9eb-e4f8-4ffa-94d6-e360d578f101 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.614647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-5095b244-56bb-4703-81ec-0bc9e8b42eae req-a335c9eb-e4f8-4ffa-94d6-e360d578f101 service nova] Creating event network-vif-plugged:13e896be-af8b-4c5b-b2fe-cd245c3385d1 for instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade on hv-cinder-82016 Jan 21 13:49:55.619508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-5095b244-56bb-4703-81ec-0bc9e8b42eae req-a335c9eb-e4f8-4ffa-94d6-e360d578f101 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031946 Jan 21 13:49:55.620273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 231/484] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:55.735994 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:55.736728 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:55.742810 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.743247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.744024 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.744460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.883868 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:55.892388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:55.893763 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:55.895108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-704d3fe4-c166-4eca-ba4a-9510b14f283f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.163316 Jan 21 13:49:55.896294 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 232/485] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:55 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:49:55.900030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bdb84a43-215b-4a05-8788-810ccec945ba tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.542556 Jan 21 13:49:55.901065 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 254/486] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:49:55 2022] POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:55.905290 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:55.906097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:55.909047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:55.909653 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:55.912112 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.912555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.913534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.914189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.918729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.919184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:55.921546 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:55.923216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:56.127795 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:56.137969 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-dad28d20-d3ab-4f1a-ba74-3dafd9f61622 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.240136 Jan 21 13:49:56.139130 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 233/487] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:55 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:56.144625 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-c29a3fe3-6dfd-46cf-8a92-5df8d1a81884 req-f56c3941-d38a-4257-8c41-61b8256fd898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db945-4044-472e-89aa-39c0d1c95ea1", "tag": "2496e76e-909a-4437-9b2f-e13165d82630"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:49:56.146255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:49:56.146255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:49:56.154911 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-c29a3fe3-6dfd-46cf-8a92-5df8d1a81884 req-f56c3941-d38a-4257-8c41-61b8256fd898 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:56.155355 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-c29a3fe3-6dfd-46cf-8a92-5df8d1a81884 req-f56c3941-d38a-4257-8c41-61b8256fd898 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:56.168734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:56.170469 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-c29a3fe3-6dfd-46cf-8a92-5df8d1a81884 req-f56c3941-d38a-4257-8c41-61b8256fd898 service nova] Creating event network-changed:2496e76e-909a-4437-9b2f-e13165d82630 for instance 701db945-4044-472e-89aa-39c0d1c95ea1 on hv-cinder-82016 Jan 21 13:49:56.175764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-c29a3fe3-6dfd-46cf-8a92-5df8d1a81884 req-f56c3941-d38a-4257-8c41-61b8256fd898 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035227 Jan 21 13:49:56.176471 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5dd4a89f-0845-4175-b6f0-d7d94d5d1114 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1755 microversion: 2.1 time: 0.270917 Jan 21 13:49:56.176787 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 234/488] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:56.178878 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 255/489] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:55 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:49:56.263748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:56.264464 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:56.278761 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:56.279820 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:56.284187 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:56.284299 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:56.441853 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:56.453524 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-317e2bfb-0507-454c-abb0-74c7565c889a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.193916 Jan 21 13:49:56.456084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 235/490] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:56 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:56.914171 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:56.914780 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:56.922355 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:56.922801 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:56.923589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:56.924028 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.061775 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:57.069439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:57.070937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:57.072076 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ad04952b-f549-45b9-8239-c94c4c8cc151 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.161787 Jan 21 13:49:57.072669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 256/491] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:56 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:57.156624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:57.157376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:57.164636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.165100 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.166122 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.166737 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.312636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:57.321486 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2014c173-93b2-4cc5-a0ca-b2eea98f96ac tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.169892 Jan 21 13:49:57.322071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 236/492] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:57 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:57.472323 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:57.472959 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:57.478935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.479393 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.480694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.481140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.630849 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:57.639556 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-773e1953-85bc-41a2-8ac0-3fe4eb9f8909 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.170882 Jan 21 13:49:57.640124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 257/493] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:57 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:57.764342 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:57.764970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:57.770833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.771282 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.772110 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.772595 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.855950 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lazy-loading 'services' on Instance uuid 6f688f4e-9f41-43fb-aacc-58a71f34e07b {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:49:57.927158 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-eaf9dca3-e785-4dd2-b568-59befba25c78 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments/472f64d0-ade8-4acd-a02a-dcb69bec5a8e" status: 202 len: 0 microversion: 2.1 time: 0.166842 Jan 21 13:49:57.927772 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 237/494] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:49:57 2022] DELETE /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments/472f64d0-ade8-4acd-a02a-dcb69bec5a8e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:49:57.936447 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-385452ea-e85f-4702-b332-4f000411c80b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:57.937534 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-385452ea-e85f-4702-b332-4f000411c80b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:57.945620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-385452ea-e85f-4702-b332-4f000411c80b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.946075 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-385452ea-e85f-4702-b332-4f000411c80b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.946884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-385452ea-e85f-4702-b332-4f000411c80b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:57.947328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-385452ea-e85f-4702-b332-4f000411c80b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:57.978186 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-385452ea-e85f-4702-b332-4f000411c80b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045533 Jan 21 13:49:57.978684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 258/495] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:49:57 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:58.093567 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:58.094495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:58.101030 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:58.101583 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:58.102451 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:58.102881 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:58.236810 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:58.244537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:58.246163 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:58.247376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-61cf7584-e713-4dd6-910a-266e883b48bd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.159704 Jan 21 13:49:58.247967 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 238/496] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:58 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:58.338217 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:58.338820 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:58.345517 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:58.345939 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:58.346708 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:58.347143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:58.481247 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:58.488860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-eed79ad2-8a05-4777-b513-16904d2c12d2 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.154240 Jan 21 13:49:58.489424 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 259/497] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:58 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:58.656941 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:58.657592 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:58.663893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:58.664675 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:58.665471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:58.665904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:58.806245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:58.815156 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-99dc45fb-bf36-4054-8d00-240585567c8c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.162178 Jan 21 13:49:58.815726 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 239/498] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:58 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:58.990413 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4f0c30cb-d1f3-433c-9b28-e5c480cf56a9 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:58.991304 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4f0c30cb-d1f3-433c-9b28-e5c480cf56a9 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:58.998217 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f0c30cb-d1f3-433c-9b28-e5c480cf56a9 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:58.999071 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f0c30cb-d1f3-433c-9b28-e5c480cf56a9 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:58.999860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f0c30cb-d1f3-433c-9b28-e5c480cf56a9 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:59.000301 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f0c30cb-d1f3-433c-9b28-e5c480cf56a9 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:59.034979 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4f0c30cb-d1f3-433c-9b28-e5c480cf56a9 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048328 Jan 21 13:49:59.035588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 260/499] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:49:58 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:49:59.266708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:59.267339 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:59.273663 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:59.274106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:59.274884 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:59.275320 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:59.417046 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:59.424760 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:59.426483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:59.427698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-664a6eb8-842a-4fec-ba16-caf0225b32d6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.165264 Jan 21 13:49:59.428329 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 240/500] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:49:59 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:49:59.506097 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:59.506720 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:59.513959 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:59.514419 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:59.515204 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:59.515643 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:59.674191 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:49:59.684301 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-62eac99f-335e-41bf-bd57-0e996eef238a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.181796 Jan 21 13:49:59.695655 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 261/501] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:59 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:49:59.834020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:49:59.834904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:49:59.841805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:59.842558 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:49:59.843716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:49:59.844350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:00.033989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:00.047103 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-da6eab6b-8ac1-41db-8bfe-383dcf28a619 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:00.048012 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-da6eab6b-8ac1-41db-8bfe-383dcf28a619 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:00.059406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-51ec9279-a2e8-45d4-a938-c77320089dd0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.226328 Jan 21 13:50:00.075496 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da6eab6b-8ac1-41db-8bfe-383dcf28a619 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:00.076254 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 241/502] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:49:59 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:00.077131 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da6eab6b-8ac1-41db-8bfe-383dcf28a619 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:00.079630 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da6eab6b-8ac1-41db-8bfe-383dcf28a619 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:00.080514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da6eab6b-8ac1-41db-8bfe-383dcf28a619 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:00.117614 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-da6eab6b-8ac1-41db-8bfe-383dcf28a619 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074842 Jan 21 13:50:00.119125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 262/503] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:50:00 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:50:00.447580 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:00.448326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:00.455624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:00.456186 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:00.457089 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:00.457627 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:00.632161 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:00.644533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:00.646865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:00.648323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c7cbc535-9ee3-4977-b2b1-8fc911fc47ba tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.204446 Jan 21 13:50:00.649278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 242/504] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:00 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:00.704573 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:00.705465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:00.711540 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:00.712918 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:00.714030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:00.714905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:00.872527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:00.880695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4192a698-40b9-490a-8617-669b7a78ddc3 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.182009 Jan 21 13:50:00.881533 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 263/505] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:00 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:01.082481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:01.083426 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:01.091336 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.091790 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.092989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.093621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.246978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:01.255820 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-444d0fef-19b3-4af4-9e33-1d62eafda786 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.177620 Jan 21 13:50:01.260765 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 243/506] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:01 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:01.395811 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:01.397653 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:01.406585 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.407367 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.408164 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.408589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.439871 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:50:01.523592 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0ab9a9a3-f574-4315-99e5-94796cfc548c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 204 len: 0 microversion: 2.1 time: 0.132989 Jan 21 13:50:01.524563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 264/507] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:50:01 2022] DELETE /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:50:01.533744 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:01.535096 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:01.545586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.546574 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.548052 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.548785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.673316 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:01.674635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:01.681900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.682351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.684949 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.686204 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.729492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:01.738418 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d6168999-64ff-41ee-a991-9cfb52f3487a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1513 microversion: 2.1 time: 0.208949 Jan 21 13:50:01.739302 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 244/508] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:01 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:01.845559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:01.853855 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:01.855690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:01.856914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fb1f721d-a153-47e3-94fe-0ba1a479e2a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.190254 Jan 21 13:50:01.872290 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 265/509] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:01 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:01.899479 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:01.900248 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:01.907640 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.908097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:01.908913 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:01.909353 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:02.275153 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:02.275756 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:02.285351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:02.285797 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:02.286599 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:02.287034 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:02.322211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:02.329586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6bac59e6-452e-4434-9a9e-26daecf8eb4b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.433651 Jan 21 13:50:02.330448 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 245/510] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:01 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:02.504423 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:02.513193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3528c6f4-31ed-4ce0-8729-f02c5682f8f8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.243167 Jan 21 13:50:02.514323 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 266/511] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:02 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:02.758780 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:02.759391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:02.770992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:02.771438 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:02.772460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:02.772923 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:02.875361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:02.875968 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:02.885853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:02.887145 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:02.888043 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:02.888595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:02.968668 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:02.977728 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8043a377-4301-4414-938f-e56ea36ca21c tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1513 microversion: 2.1 time: 0.222649 Jan 21 13:50:02.978955 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 246/512] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:02 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:03.082988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:03.094357 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:03.095866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:03.097134 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fbb46d90-e337-4b9f-b988-e0055ca59b0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.226056 Jan 21 13:50:03.100661 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 267/513] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:02 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:03.348489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:03.349047 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:03.354929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:03.355411 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:03.356163 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:03.356595 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:03.529830 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:03.533537 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:03.534240 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:03.538760 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a7a00700-d345-44e3-868e-3bafab3c176c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.194818 Jan 21 13:50:03.540840 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:03.541511 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:03.543113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:03.543807 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:03.553344 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 247/514] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:03 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:03.692655 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:03.704882 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-34e45b4e-5bd1-4533-81a8-12be0ac2d610 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.173447 Jan 21 13:50:03.705798 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 268/515] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:03 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:03.995195 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:03.996481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:04.002538 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.002986 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.003761 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.004188 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.115872 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:04.116459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:04.134618 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.135084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.135888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.137069 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.190018 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:04.201223 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5754ff77-b7ee-4079-af23-69906888f4d6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1513 microversion: 2.1 time: 0.209635 Jan 21 13:50:04.211003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 248/516] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:03 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:04.457900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:04.513132 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:04.516845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:04.518168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-725fcf9a-87f2-4026-954f-a0c2a6e9cf7a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.406138 Jan 21 13:50:04.532594 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 269/517] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:04 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:04.557451 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:04.558545 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:04.565075 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.565750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.566712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.567313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.725191 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:04.725904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:04.738674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.742784 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.743715 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.745796 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.809642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:04.819029 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fb62797b-82b1-4932-9b4b-616a4f828225 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.265450 Jan 21 13:50:04.822982 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 249/518] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:04 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:04.883919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-758fb81c-c9b4-4154-9fa2-44af74d7781f req-41e158e8-c4ed-4822-9e23-3162bac59dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f688f4e-9f41-43fb-aacc-58a71f34e07b", "name": "network-vif-deleted", "tag": "44df63fb-31a8-41f0-9f36-5eb26e076375"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:04.886743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:04.886743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:50:04.898319 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-758fb81c-c9b4-4154-9fa2-44af74d7781f req-41e158e8-c4ed-4822-9e23-3162bac59dea service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:04.898854 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-758fb81c-c9b4-4154-9fa2-44af74d7781f req-41e158e8-c4ed-4822-9e23-3162bac59dea service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:04.913048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-758fb81c-c9b4-4154-9fa2-44af74d7781f req-41e158e8-c4ed-4822-9e23-3162bac59dea service nova] Creating event network-vif-deleted:44df63fb-31a8-41f0-9f36-5eb26e076375 for instance 6f688f4e-9f41-43fb-aacc-58a71f34e07b on hv-cinder-82016 Jan 21 13:50:04.921993 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-758fb81c-c9b4-4154-9fa2-44af74d7781f req-41e158e8-c4ed-4822-9e23-3162bac59dea service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042902 Jan 21 13:50:04.923890 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 250/519] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:05.077647 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:05.087901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9756b155-fd1d-4a87-8073-369efadc72e6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.368056 Jan 21 13:50:05.088831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 270/520] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:04 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:05.218501 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:05.219322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:05.226538 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:05.226973 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:05.228645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:05.228645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:05.266985 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:05.267446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:05.267916 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lazy-loading 'fault' on Instance uuid 6f688f4e-9f41-43fb-aacc-58a71f34e07b {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:50:05.316047 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:05.336983 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-041303ac-6962-481c-a5b3-4c36b4bf8abe tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 200 len: 1307 microversion: 2.1 time: 0.122249 Jan 21 13:50:05.348293 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 251/521] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:05 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:05.539370 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:05.540084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:05.548496 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:05.550597 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:05.552225 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:05.552703 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:05.756358 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:05.765793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:05.767781 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:05.769226 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1116ee61-483e-4d85-8b43-ae0fe6fe9c21 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.234604 Jan 21 13:50:05.773156 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 271/522] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:05 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:05.838593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:05.840314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:05.848693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:05.849436 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:05.850453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:05.851083 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:06.020736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:06.030123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f6c457a3-1a1d-4779-a570-934a51edca06 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.196931 Jan 21 13:50:06.036594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 252/523] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:05 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:06.106819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:06.106819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:06.113119 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:06.114591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:06.114591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:06.114880 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:06.260174 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:06.278618 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3a299760-1750-426c-8b5a-6b15398832aa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.176808 Jan 21 13:50:06.288414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 272/524] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:06 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:06.356128 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:06.357548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 6f688f4e-9f41-43fb-aacc-58a71f34e07b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:06.368797 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:06.369837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:06.370899 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:06.371861 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:06.392416 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] HTTP exception thrown: Instance 6f688f4e-9f41-43fb-aacc-58a71f34e07b could not be found. Jan 21 13:50:06.393106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Returning 404 to user: Instance 6f688f4e-9f41-43fb-aacc-58a71f34e07b could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:50:06.393959 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-85028159-5b7a-4d37-8695-746474a92380 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b" status: 404 len: 111 microversion: 2.1 time: 0.042647 Jan 21 13:50:06.394807 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 253/525] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:06 2022] GET /compute/v2.1/servers/6f688f4e-9f41-43fb-aacc-58a71f34e07b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:50:06.791538 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:06.792142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:06.799042 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:06.799505 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:06.800297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:06.800777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:06.943235 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:06.954538 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:06.956269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:06.957474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c6631df5-0f7f-4908-bfd0-adef242b11fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.169787 Jan 21 13:50:06.969713 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 273/526] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:06 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:07.048189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:07.048832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:07.054750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.055335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.055997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.056439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.208782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:07.217475 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2d1995f9-6547-4bb0-a807-d5d89c90fa35 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1569 microversion: 2.1 time: 0.172851 Jan 21 13:50:07.224682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 254/527] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:07 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:07.295976 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:07.296844 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:07.306089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.306571 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.307847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.308863 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.464295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:07.474290 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6d0216d9-b87c-4c9f-8617-5929d26bad22 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.182876 Jan 21 13:50:07.484053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 274/528] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:07 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:07.554617 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:07.555758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:07.564526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.565074 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.565991 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.566492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.595484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:50:07.691692 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c10a8623-b97f-4d8a-82fe-383d38cec713 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 204 len: 0 microversion: 2.1 time: 0.138041 Jan 21 13:50:07.692647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 255/529] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:50:07 2022] DELETE /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 13:50:07.704082 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:07.704437 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:07.711385 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.711857 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.713310 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.714255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.879124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:07.886633 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-88573407-f560-49c9-abfa-cca1c8b4f996 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1511 microversion: 2.1 time: 0.189732 Jan 21 13:50:07.887498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 275/530] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:07 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:07.979482 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:07.981105 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:07.987901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.988359 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:07.989195 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:07.989761 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.169164 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:08.177019 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:08.178653 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:08.179779 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c6c12730-cd05-4611-aac1-92fdf713bf43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.206413 Jan 21 13:50:08.180584 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 256/531] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:07 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:08.236510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:08.237088 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:08.244188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.245169 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.246890 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.247336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.426472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:08.435168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-50843575-06f6-4303-a764-4d7b4c8626fe tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1549 microversion: 2.1 time: 0.202702 Jan 21 13:50:08.435920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 276/532] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:08 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1549 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:08.457442 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:08.458202 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:08.464864 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.465355 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.466046 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.466531 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.491178 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:08.492477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:08.507956 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.508714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.509682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.512173 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.617402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] HTTP exception thrown: Cannot 'detach_volume' instance 12549874-6848-4a56-b964-807011e2d9be while it is in vm_state rescued Jan 21 13:50:08.618681 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Returning 409 to user: Cannot 'detach_volume' instance 12549874-6848-4a56-b964-807011e2d9be while it is in vm_state rescued {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:50:08.619506 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-baf44167-eddf-40e0-8c33-8d94fff88967 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "DELETE /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments/1d267c86-b905-4ae0-ab9a-fe83abb19bd7" status: 409 len: 152 microversion: 2.1 time: 0.166061 Jan 21 13:50:08.620056 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 257/533] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:50:08 2022] DELETE /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments/1d267c86-b905-4ae0-ab9a-fe83abb19bd7 => generated 152 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 21 13:50:08.628786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7ea92c7b-45b9-4d39-a10b-e57aedb695ba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:08.629765 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7ea92c7b-45b9-4d39-a10b-e57aedb695ba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:08.637283 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7ea92c7b-45b9-4d39-a10b-e57aedb695ba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.637992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7ea92c7b-45b9-4d39-a10b-e57aedb695ba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.640106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7ea92c7b-45b9-4d39-a10b-e57aedb695ba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.640844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7ea92c7b-45b9-4d39-a10b-e57aedb695ba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.727836 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:08.738506 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d1234e35-1d29-403c-97df-acfecc8efa1b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.251004 Jan 21 13:50:08.739088 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 277/534] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:08 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:08.740529 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7ea92c7b-45b9-4d39-a10b-e57aedb695ba tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action" status: 202 len: 0 microversion: 2.1 time: 0.115077 Jan 21 13:50:08.741387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 258/535] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:50:08 2022] POST /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:50:08.749766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:08.750008 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:08.756323 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.756777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.757587 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.758104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.904803 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:08.905519 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:08.911520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.911975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:08.912823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:08.913279 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:09.049353 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:09.056552 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6bceae7a-8f36-4031-b3fe-b0a8ae309be6 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1511 microversion: 2.1 time: 0.156693 Jan 21 13:50:09.057180 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 259/536] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:08 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:09.142876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:09.150681 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-36eb0910-dae2-43db-a78e-44f5c7c39912 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1557 microversion: 2.1 time: 0.405089 Jan 21 13:50:09.151359 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 278/537] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:08 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1557 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:09.198938 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:09.199675 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:09.206062 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:09.206518 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:09.207307 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:09.207774 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:09.349711 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:09.358112 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:09.359661 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:09.360992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4a619200-3929-445a-9562-473af5a302ed tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.165711 Jan 21 13:50:09.361407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 260/538] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:09 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:09.755535 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:09.756139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:09.762264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:09.762710 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:09.763479 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:09.763907 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:09.993152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:10.001697 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-284a5d51-e6d3-4726-aea2-89d5bbc7751a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.249682 Jan 21 13:50:10.002273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 279/539] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:09 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:10.074304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:10.074916 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:10.081097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:10.081543 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:10.082314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:10.082746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:10.169488 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:10.170110 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:10.176226 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:10.176711 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:10.177499 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:10.177977 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:10.230665 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:10.238642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f68cb114-d3d1-4fb7-bf5f-41f34a4b68c4 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1511 microversion: 2.1 time: 0.168168 Jan 21 13:50:10.239443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 261/540] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:10 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:10.379475 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:10.380724 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:10.389406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:10.389406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:10.389406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:10.389406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:10.398781 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:10.410213 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8d5e8f95-9dbb-4a24-bed5-ad490217ceb8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1557 microversion: 2.1 time: 0.243997 Jan 21 13:50:10.421356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 280/541] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:10 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1557 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:10.532549 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:10.540716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:10.542852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:10.544589 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-833b90a0-3b66-40d5-bf7e-bc932ab096df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1740 microversion: 2.20 time: 0.169160 Jan 21 13:50:10.545554 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 262/542] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:10 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:10.719981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-048cf362-bc76-4528-8a03-568905f215d7 req-94dad56f-6406-4b05-8d67-8311aa7165d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4262414e-91b5-4f61-9b5c-c51380f5fc46", "name": "network-vif-deleted", "tag": "c58b0585-9bc6-4560-a4be-2cdbe88f5e2b"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:10.721665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:10.721665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:50:10.740096 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-048cf362-bc76-4528-8a03-568905f215d7 req-94dad56f-6406-4b05-8d67-8311aa7165d4 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:10.741005 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-048cf362-bc76-4528-8a03-568905f215d7 req-94dad56f-6406-4b05-8d67-8311aa7165d4 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:10.754472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-048cf362-bc76-4528-8a03-568905f215d7 req-94dad56f-6406-4b05-8d67-8311aa7165d4 service nova] Creating event network-vif-deleted:c58b0585-9bc6-4560-a4be-2cdbe88f5e2b for instance 4262414e-91b5-4f61-9b5c-c51380f5fc46 on hv-cinder-82016 Jan 21 13:50:10.760078 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-048cf362-bc76-4528-8a03-568905f215d7 req-94dad56f-6406-4b05-8d67-8311aa7165d4 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043648 Jan 21 13:50:10.764588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 281/543] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:11.018561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:11.019154 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:11.025143 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.025594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.026362 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.027357 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.165429 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:11.174615 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-db5cf996-c5ed-428d-9f05-b005e9bf797c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.159293 Jan 21 13:50:11.180883 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 263/544] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:11 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:11.258045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:11.258750 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:11.264804 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.265264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.266041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.266480 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.297359 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.297815 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.299308 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lazy-loading 'fault' on Instance uuid 4262414e-91b5-4f61-9b5c-c51380f5fc46 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:50:11.342665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:11.349845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b3a004e-08ae-41fb-a470-9f6525e1cd0f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 200 len: 1306 microversion: 2.1 time: 0.097755 Jan 21 13:50:11.350419 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 282/545] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:11 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:11.427344 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:11.428013 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:11.434338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.434878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.435740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.436257 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.562780 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:11.563425 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:11.565110 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:11.569385 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.569848 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.570636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:11.571074 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:11.572827 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3038420a-4be3-414a-983d-23eef3746972 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1557 microversion: 2.1 time: 0.149388 Jan 21 13:50:11.573959 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 264/546] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:11 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:11.704871 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:11.712416 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:11.714577 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:11.715727 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-958c57b2-2ae0-4019-931e-a9778ad42d98 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1722 microversion: 2.20 time: 0.156749 Jan 21 13:50:11.716283 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 283/547] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:11 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:12.192493 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:12.193373 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:12.201456 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.201910 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.202746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.203136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.269471 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1830855065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-286078649", "security_groups": [{"name": "tempest-secgroup-smoke-1879539442"}], "networks": [{"uuid": "cd41fb5e-9dae-4723-9b7f-8f2abd83ac07"}], "block_device_mapping_v2": [{"uuid": "c7f5b4ce-9e2f-4028-90d7-20bb223553c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:12.344456 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:12.353208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-eed9b107-381b-444b-9c9b-9343c23f291c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.164500 Jan 21 13:50:12.354192 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 265/548] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:12 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:12.366942 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:12.367563 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: 4262414e-91b5-4f61-9b5c-c51380f5fc46] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:12.374295 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.374745 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.375543 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.375980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.383365 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] validate_networks() for [('cd41fb5e-9dae-4723-9b7f-8f2abd83ac07', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:50:12.389306 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] HTTP exception thrown: Instance 4262414e-91b5-4f61-9b5c-c51380f5fc46 could not be found. Jan 21 13:50:12.389904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Returning 404 to user: Instance 4262414e-91b5-4f61-9b5c-c51380f5fc46 could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:50:12.390728 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-aeb04f51-8ada-45cd-9709-cceff64a6a25 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46" status: 404 len: 111 microversion: 2.1 time: 0.027499 Jan 21 13:50:12.391273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 266/549] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:12 2022] GET /compute/v2.1/servers/4262414e-91b5-4f61-9b5c-c51380f5fc46 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:50:12.398733 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:12.399224 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:12.405829 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.406281 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.407057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.407494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.432546 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:50:12.520489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3265badb-7b80-4b85-a2e8-396afe6600b8 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "DELETE /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 204 len: 0 microversion: 2.1 time: 0.124515 Jan 21 13:50:12.521448 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 267/550] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:50:12 2022] DELETE /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 13:50:12.531865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:12.532560 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:12.538590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.539038 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.539811 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.540238 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.693932 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:12.701880 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8f3cfcba-36b4-42cf-89b9-3f718a46d873 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1513 microversion: 2.1 time: 0.174599 Jan 21 13:50:12.702460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 268/551] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:12 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:12.706672 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:12.707269 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:12.713055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.713511 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.714322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.714742 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.782342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:50:12.782785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:50:12.783265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:50:12.783678 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:50:12.784095 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:50:12.792829 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.793495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.794315 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.794755 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.811964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Getting quotas for project 160416387af942969baffb4cbd2e83bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:50:12.815979 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Getting quotas for user 16130424abc7467584acb6f15dbf544d and project 160416387af942969baffb4cbd2e83bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:50:12.850735 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:12.860003 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9f46c05c-fc65-453b-b336-3cef6e623460 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1563 microversion: 2.1 time: 0.156324 Jan 21 13:50:12.860566 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 269/552] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:12 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:12.866639 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:12.867242 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:12.873674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.874080 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.874856 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:12.875296 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:12.875936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:50:12.878103 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7f5b4ce-9e2f-4028-90d7-20bb223553c7',volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:50:13.007786 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-99be63c0-32ad-4117-a55c-dd67596a4461 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741895 Jan 21 13:50:13.008437 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 284/553] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:50:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:50:13.019337 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:13.019894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:13.023898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:13.026410 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.026874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.028345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.028831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.035395 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:13.037070 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:13.039323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a9c3debd-8279-4871-a011-b85019464ae6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1722 microversion: 2.20 time: 0.177944 Jan 21 13:50:13.049322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 270/554] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:12 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:13.054187 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-02429113-ef4d-4203-8145-8c6e0a19d9d3 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:13.055004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-02429113-ef4d-4203-8145-8c6e0a19d9d3 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:13.118708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-02429113-ef4d-4203-8145-8c6e0a19d9d3 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:13.126113 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-02429113-ef4d-4203-8145-8c6e0a19d9d3 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1088 microversion: 2.1 time: 0.075752 Jan 21 13:50:13.126681 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 271/555] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:13 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:13.134207 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lazy-loading 'services' on Instance uuid 12549874-6848-4a56-b964-807011e2d9be {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:50:13.207998 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2ffd5b46-bf22-406e-9183-667a7c4ea7b8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "DELETE /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments/1d267c86-b905-4ae0-ab9a-fe83abb19bd7" status: 202 len: 0 microversion: 2.1 time: 0.193173 Jan 21 13:50:13.208985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 285/556] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:50:13 2022] DELETE /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments/1d267c86-b905-4ae0-ab9a-fe83abb19bd7 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:50:13.218468 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-819f48a5-3677-4958-8d33-dd7cea32507b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:13.220037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-819f48a5-3677-4958-8d33-dd7cea32507b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:13.228839 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-819f48a5-3677-4958-8d33-dd7cea32507b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.229276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-819f48a5-3677-4958-8d33-dd7cea32507b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.230074 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-819f48a5-3677-4958-8d33-dd7cea32507b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.231151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-819f48a5-3677-4958-8d33-dd7cea32507b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.267924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-819f48a5-3677-4958-8d33-dd7cea32507b tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054208 Jan 21 13:50:13.268645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 272/557] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:50:13 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:13.374030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:13.376389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:13.384765 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.386584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.392389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.392389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.548846 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:13.556775 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7509b8e7-b58a-44ed-a174-bd614118d09e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1722 microversion: 2.1 time: 0.188728 Jan 21 13:50:13.557744 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 286/558] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:13 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:13.720106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:13.720804 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:13.726870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.727328 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.728192 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:13.728654 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:13.862636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:13.873482 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4a41c3d7-5806-4432-9b52-ae86bd592dd3 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1513 microversion: 2.1 time: 0.157822 Jan 21 13:50:13.874052 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 273/559] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:13 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:14.059220 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:14.060229 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:14.067069 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.067454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.068244 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.068707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.142408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:14.143016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:14.151188 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.151638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.153810 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.154541 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.221400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:14.229075 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-84b351b7-858b-416b-a190-86252d59b054 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1186 microversion: 2.1 time: 0.090239 Jan 21 13:50:14.229648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 274/560] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:14 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:14.258555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:14.267494 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:14.269167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:14.270342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-648247f2-60cb-477a-b332-807d1c7aef3b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1665 microversion: 2.20 time: 0.216637 Jan 21 13:50:14.271100 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 287/561] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:14 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1665 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:14.288743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6a76a2b6-7578-4ab0-8569-7d1708a970bc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:14.289656 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6a76a2b6-7578-4ab0-8569-7d1708a970bc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:14.290527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6265e451-61af-4a62-b1d2-6498ae13750c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9bf889e-5ee5-47a9-8841-7ee5d3ac8b91"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:14.291733 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6265e451-61af-4a62-b1d2-6498ae13750c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:14.296896 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a76a2b6-7578-4ab0-8569-7d1708a970bc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.297345 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a76a2b6-7578-4ab0-8569-7d1708a970bc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.298129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a76a2b6-7578-4ab0-8569-7d1708a970bc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.298550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6265e451-61af-4a62-b1d2-6498ae13750c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.298683 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a76a2b6-7578-4ab0-8569-7d1708a970bc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.299041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6265e451-61af-4a62-b1d2-6498ae13750c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.310983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6265e451-61af-4a62-b1d2-6498ae13750c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.310983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6265e451-61af-4a62-b1d2-6498ae13750c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.338908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6a76a2b6-7578-4ab0-8569-7d1708a970bc tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053777 Jan 21 13:50:14.344480 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 275/562] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:50:14 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:50:14.511650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-cccce41a-3032-491a-abf4-e36c7c55d24e req-c9b2be6a-0b85-43d4-8eb1-1acb520d17cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade", "name": "network-vif-unplugged", "status": "completed", "tag": "13e896be-af8b-4c5b-b2fe-cd245c3385d1"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:14.513950 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:14.513950 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:50:14.521844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-cccce41a-3032-491a-abf4-e36c7c55d24e req-c9b2be6a-0b85-43d4-8eb1-1acb520d17cb service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.522321 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-cccce41a-3032-491a-abf4-e36c7c55d24e req-c9b2be6a-0b85-43d4-8eb1-1acb520d17cb service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.542535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.compute.server_external_events [req-cccce41a-3032-491a-abf4-e36c7c55d24e req-c9b2be6a-0b85-43d4-8eb1-1acb520d17cb service nova] Unable to find a host for instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade. Dropping event network-vif-unplugged {{(pid=122813) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 21 13:50:14.544403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-cccce41a-3032-491a-abf4-e36c7c55d24e req-c9b2be6a-0b85-43d4-8eb1-1acb520d17cb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038806 Jan 21 13:50:14.545525 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 276/563] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 21 13:50:14.587318 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:14.588529 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:14.610420 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.611167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.612334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.612918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.779065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:14.789887 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-65902928-56ef-484e-b324-817fb144717b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1699 microversion: 2.1 time: 0.215264 Jan 21 13:50:14.791144 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 277/564] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:14 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1699 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:14.807794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f2a4d395-e4f8-44ca-9a36-ee73baa2a0b9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:14.818160 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2a4d395-e4f8-44ca-9a36-ee73baa2a0b9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.818748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2a4d395-e4f8-44ca-9a36-ee73baa2a0b9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.847432 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f2a4d395-e4f8-44ca-9a36-ee73baa2a0b9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Going to try to start instance {{(pid=122813) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 21 13:50:14.862111 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6265e451-61af-4a62-b1d2-6498ae13750c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.576125 Jan 21 13:50:14.863175 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 288/565] 10.222.0.84 () {62 vars in 1363 bytes} [Fri Jan 21 13:50:14 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments => generated 188 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:50:14.893249 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:14.894348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:14.912102 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.913844 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.915628 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f2a4d395-e4f8-44ca-9a36-ee73baa2a0b9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 202 len: 0 microversion: 2.1 time: 0.111749 Jan 21 13:50:14.916288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.920725 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.922641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 278/566] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:50:14 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:50:14.937403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:14.938605 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:14.946818 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.947548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:14.948863 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:14.950292 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.161735 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:15.171489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f5b68f91-8a88-4ce7-b0f3-d9c4dd466965 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1708 microversion: 2.1 time: 0.247264 Jan 21 13:50:15.182181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 279/567] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:14 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1708 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:15.190362 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fd76b838-d4f8-485e-88cc-611815545d82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:15.191223 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fd76b838-d4f8-485e-88cc-611815545d82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:15.197553 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fd76b838-d4f8-485e-88cc-611815545d82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:15.198159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fd76b838-d4f8-485e-88cc-611815545d82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.199038 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fd76b838-d4f8-485e-88cc-611815545d82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:15.199548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fd76b838-d4f8-485e-88cc-611815545d82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.313536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fd76b838-d4f8-485e-88cc-611815545d82 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action" status: 202 len: 0 microversion: 2.20 time: 0.128662 Jan 21 13:50:15.314294 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 280/568] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:50:15 2022] POST /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:50:15.319021 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:15.319711 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:15.326182 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:15.327217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:15.327567 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.328463 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:15.329209 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.340810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-adc5c617-7b53-45c6-845c-3fd096b0ee95 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 200 len: 1513 microversion: 2.1 time: 0.452781 Jan 21 13:50:15.342467 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 289/569] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:14 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 1513 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:15.348535 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:15.349519 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:15.359636 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:15.360511 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.361931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:15.362763 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.419293 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:15.432292 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c8b1eeb7-b94c-4bc6-bcea-15ec6a0d1cfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1192 microversion: 2.1 time: 0.116637 Jan 21 13:50:15.433212 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 281/570] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:15 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:15.642136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-9d617af1-09c8-41ad-85fa-fbba56431847 req-9638b0e9-aac6-43ba-b5d2-5fcb1cb6798a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f4ec04-0507-4d14-bd50-081d379d0ecf", "name": "network-vif-deleted", "tag": "6158ddf8-bb57-41da-8425-5bb12d1f9863"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:15.643718 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:15.643718 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:50:15.658924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-9d617af1-09c8-41ad-85fa-fbba56431847 req-9638b0e9-aac6-43ba-b5d2-5fcb1cb6798a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:15.659366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-9d617af1-09c8-41ad-85fa-fbba56431847 req-9638b0e9-aac6-43ba-b5d2-5fcb1cb6798a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:15.679704 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-9d617af1-09c8-41ad-85fa-fbba56431847 req-9638b0e9-aac6-43ba-b5d2-5fcb1cb6798a service nova] Creating event network-vif-deleted:6158ddf8-bb57-41da-8425-5bb12d1f9863 for instance b1f4ec04-0507-4d14-bd50-081d379d0ecf on hv-cinder-82016 Jan 21 13:50:15.687617 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-9d617af1-09c8-41ad-85fa-fbba56431847 req-9638b0e9-aac6-43ba-b5d2-5fcb1cb6798a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050529 Jan 21 13:50:15.692006 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 282/571] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:15.924176 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:15.935459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:15.938036 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:15.957721 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e0a513fa-e052-40ab-a37f-5308ada71815 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1751 microversion: 2.20 time: 0.610194 Jan 21 13:50:15.959534 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 290/572] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:15 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1751 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:16.192076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:16.192965 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:16.206057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.207624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.210841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.211577 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.360139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:16.360908 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: b1f4ec04-0507-4d14-bd50-081d379d0ecf] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:16.375994 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.376572 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.378076 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.378953 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.410840 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] HTTP exception thrown: Instance b1f4ec04-0507-4d14-bd50-081d379d0ecf could not be found. Jan 21 13:50:16.411460 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Returning 404 to user: Instance b1f4ec04-0507-4d14-bd50-081d379d0ecf could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:50:16.412504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6f0df8b6-b277-47a0-bb43-4f10ece79f15 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf" status: 404 len: 111 microversion: 2.1 time: 0.057456 Jan 21 13:50:16.416132 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 291/573] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:16 2022] GET /compute/v2.1/servers/b1f4ec04-0507-4d14-bd50-081d379d0ecf => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:50:16.438748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:16.449553 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b12e1f2f-7798-4862-be3a-a1573b42c5b3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1708 microversion: 2.1 time: 0.262732 Jan 21 13:50:16.450749 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 283/574] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:16 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1708 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:16.452889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:16.454572 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:16.468844 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.469692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.470959 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.471082 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.803484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:16.804282 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:16.811276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.812065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.812922 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.813655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.815106 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:16.825542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9c4614c5-a8f4-4331-b1d3-a6bf56711d24 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.378597 Jan 21 13:50:16.826869 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 292/575] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:16 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:16.839789 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:50:16.923123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-09dd61bc-5cff-44e6-9c8e-86a2cf580603 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 204 len: 0 microversion: 2.1 time: 0.123090 Jan 21 13:50:16.923993 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 284/576] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:50:16 2022] DELETE /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:50:16.932378 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:16.934260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:16.940401 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.940893 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.941692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.942174 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.979712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:16.981182 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:16.987762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.988204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:16.989000 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:16.989432 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.144036 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:17.152516 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:17.154398 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:17.155555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-65ab0b4e-8025-459f-9d7b-0bdd5709d000 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1753 microversion: 2.20 time: 0.179962 Jan 21 13:50:17.156276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 285/577] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:16 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:17.266417 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:17.274607 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b4c28e3b-f8a5-4357-bcbe-1e7bf0c9477c tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.346217 Jan 21 13:50:17.275175 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 293/578] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:16 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:17.472091 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:17.473143 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:17.481403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.481984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.482914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.483355 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.629841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:17.639179 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-961fde3e-e480-4450-893a-43df4017c32b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1708 microversion: 2.1 time: 0.171735 Jan 21 13:50:17.653536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 286/579] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:17 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1708 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:17.668680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:17.669801 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:17.681541 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.682287 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.683161 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.684922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.713400 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:50:17.732701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-77ece090-454a-47c0-9bf5-ab66e4d54553 req-2a10031b-396a-43cc-9930-51289caeea7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591899e6-cf08-42d3-9b97-59bfd88f7fa6", "tag": "40372efa-3a9e-443e-a378-7289829a045d"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:17.734414 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:17.734414 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:50:17.749916 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-77ece090-454a-47c0-9bf5-ab66e4d54553 req-2a10031b-396a-43cc-9930-51289caeea7b service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.750736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-77ece090-454a-47c0-9bf5-ab66e4d54553 req-2a10031b-396a-43cc-9930-51289caeea7b service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.771521 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-77ece090-454a-47c0-9bf5-ab66e4d54553 req-2a10031b-396a-43cc-9930-51289caeea7b service nova] Creating event network-changed:40372efa-3a9e-443e-a378-7289829a045d for instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 on hv-cinder-82016 Jan 21 13:50:17.779387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-77ece090-454a-47c0-9bf5-ab66e4d54553 req-2a10031b-396a-43cc-9930-51289caeea7b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050705 Jan 21 13:50:17.780223 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 287/580] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:50:17.830345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d819ed4d-f08e-4413-bec5-5b5f4814e039 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "DELETE /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 204 len: 0 microversion: 2.1 time: 0.166121 Jan 21 13:50:17.841537 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 294/581] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:50:17 2022] DELETE /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:50:17.846713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:17.847468 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:17.852866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:17.854521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:17.860023 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.860764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.862810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.863614 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.864880 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.865313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:17.867123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:17.867837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:18.015542 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:18.023500 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1fb8dd35-944d-4bf2-b4d4-c6db6b170345 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.184932 Jan 21 13:50:18.024302 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 288/582] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:17 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:18.175433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:18.176050 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:18.181764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:18.182222 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:18.183004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:18.183443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:18.214041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:18.222692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f03b0bdf-434f-4a27-b5ef-44eb15406f1b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.375584 Jan 21 13:50:18.223364 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 295/583] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:17 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:18.292743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:18.293563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:18.300597 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:18.301166 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:18.302046 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:18.302581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:18.318905 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:18.328065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:18.329799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:18.330989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ca05000c-ba83-4edc-980b-81b553393984 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.159281 Jan 21 13:50:18.340668 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 289/584] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:18 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:18.559354 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:18.566621 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9586f5ac-143b-4fce-bad3-c5d8ce673814 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.277624 Jan 21 13:50:18.567187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 296/585] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:18 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:18.659348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:18.659958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:18.666407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:18.666854 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:18.667635 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:18.668117 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:18.798775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:18.806616 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-24fe4bdb-fccd-4c76-8927-5a34c8022bea tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1712 microversion: 2.1 time: 0.150931 Jan 21 13:50:18.807190 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 290/586] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:18 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:19.041815 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:19.042590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:19.050268 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.050754 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.054304 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.054760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.241087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:19.241988 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:19.248803 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.249334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.250189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.250692 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.423559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:19.434428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-75ee0cee-0641-46c9-830d-c8d25e562b5f tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.196060 Jan 21 13:50:19.438923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:19.445147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 291/587] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:19 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:19.451448 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b37db7ad-7440-4fb3-b868-1cdf50e3054a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.413550 Jan 21 13:50:19.452073 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 297/588] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:19 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:19.452248 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:19.452893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:19.465655 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.466106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.466908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.467423 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.592543 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:19.593255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:19.609165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.609884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.611270 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:19.617414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:19.688522 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:19.703549 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:19.705620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:19.709781 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b32b7f2c-a408-4b79-949b-dfe1545873b4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.262915 Jan 21 13:50:19.711012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 292/589] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:19 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:19.809188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:19.816737 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d3f6be55-bbba-40f3-a7fe-61fae91cc5f8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.236211 Jan 21 13:50:19.827209 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 298/590] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:19 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:20.452188 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:20.452917 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:20.458760 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.459215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.459996 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.460435 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.467973 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:20.468583 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:20.474932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.475616 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.476563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.477172 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.600964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:20.609797 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-494aac56-460e-4fda-918f-b880b330d202 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.161869 Jan 21 13:50:20.610380 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 293/591] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:20 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:20.633007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:20.642009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f851e5f5-6a6c-44b6-b035-10885f604795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.177571 Jan 21 13:50:20.642889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 299/592] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:20 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:20.730041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:20.732030 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:20.739634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.740445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.741439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.742109 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.834243 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:20.835000 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:20.841987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.842449 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.843256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:20.843694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:20.883267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:20.891682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:20.893267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:20.894442 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a332d225-5e8c-4d5a-8b19-a4ea45cf6cee tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.168427 Jan 21 13:50:20.895009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 294/593] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:20 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:20.994300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:21.005768 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-84b77427-a944-426e-8acf-196fe9b80002 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.175169 Jan 21 13:50:21.006338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 300/594] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:20 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:21.626976 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:21.627584 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:21.633632 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:21.634075 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:21.634865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:21.635298 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:21.659382 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:21.660220 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:21.667914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:21.668457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:21.670119 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:21.670665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:21.774933 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:21.784555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4183aa5f-6e16-494d-aebd-b72ff1454235 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.161311 Jan 21 13:50:21.785434 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 295/595] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:21 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:21.838868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:21.847229 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-18bfc295-7f85-4d87-a571-5d5f38a2c75f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.191570 Jan 21 13:50:21.847833 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 301/596] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:21 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:21.914654 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:21.915396 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:21.922214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:21.922741 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:21.923740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:21.924244 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:22.023021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:22.024009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:22.036064 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:22.036515 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:22.037354 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:22.037796 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:22.080016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:22.091878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:22.094193 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:22.097976 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6cedf488-096a-409b-86ee-f61f6c1d9536 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.187096 Jan 21 13:50:22.099173 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 296/597] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:21 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:22.196678 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:22.204806 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8ba2a4ed-e26d-401b-a06d-f6d207c60421 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.185354 Jan 21 13:50:22.205372 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 302/598] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:22 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:22.802164 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:22.802778 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:22.809076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:22.810326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:22.811253 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:22.811694 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:22.864387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:22.865138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:22.871651 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:22.872985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:22.873865 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:22.874398 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:22.963729 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:22.977201 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-08a41043-03cd-471e-ba6e-6355dfc4e3e5 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.178592 Jan 21 13:50:22.987832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 297/599] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:22 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:23.030261 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:23.037866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7476a432-121b-499f-ada0-1febfd304b38 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.177755 Jan 21 13:50:23.038631 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 303/600] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:22 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:23.119151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:23.119762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:23.126297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:23.126873 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:23.127813 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:23.128255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:23.221904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:23.222635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:23.229300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:23.229855 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:23.230737 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:23.231245 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:23.292743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:23.303061 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:23.304689 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:23.305958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-43e976b9-c1fc-4b6d-852f-e5345311943d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.190533 Jan 21 13:50:23.307399 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 298/601] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:23 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:23.375419 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:23.383867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2e6e389a-37b1-4c4e-aefa-357c78af0552 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.166188 Jan 21 13:50:23.385232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 304/602] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:23 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:23.995101 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:23.996430 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:24.003461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.004043 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.004872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.005318 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.054994 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:24.055614 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:24.072329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.072819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.073629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.074068 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.167169 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:24.175236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1be9f77b-d035-47a6-a0cf-4e4773fccc70 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.183916 Jan 21 13:50:24.176036 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 299/603] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:23 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:24.233933 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:24.241547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-454814ee-f4c0-4d3e-906e-6caf15426d5c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.190419 Jan 21 13:50:24.242122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 305/604] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:24 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:24.325043 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:24.325792 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:24.332274 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.332851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.333722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.334247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.413703 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:24.414313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:24.428228 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.428702 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.429495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:24.429935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:24.477513 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:24.500489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:24.501167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:24.502354 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-63bc16b0-a393-4d1b-baa5-d98a16c14de8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.181138 Jan 21 13:50:24.503269 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 300/605] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:24 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:24.577542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:24.585193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a8693f92-1a18-476c-badd-67a1d70e19a0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.175082 Jan 21 13:50:24.585952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 306/606] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:24 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:25.193784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:25.194428 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:25.201048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.201537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.202354 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.202787 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.259506 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:25.260280 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:25.267546 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.268176 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.268830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.269265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.344790 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:25.367799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-94878266-9e23-470e-bcaa-b527172516a7 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.171336 Jan 21 13:50:25.368671 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 301/607] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:25 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:25.420873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:25.428075 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ee1cd127-7503-4d96-ac82-0d7cb0335b80 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.172886 Jan 21 13:50:25.428664 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 307/608] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:25 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:25.520597 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:25.521151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:25.527094 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.527543 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.528316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.529324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.603723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:25.604623 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:25.611293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.611742 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.612525 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:25.615178 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:25.681219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:25.691745 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:25.693607 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:25.694851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7a2b0e74-6b84-4728-987c-a38ad273bd9d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.178069 Jan 21 13:50:25.695747 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 302/609] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:25 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:25.755270 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:25.763454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-584ed82e-6d20-448e-bb16-d7764eb21dd0 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.163780 Jan 21 13:50:25.764395 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 308/610] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:25 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:26.385570 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:26.386515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:26.393527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.393974 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.394756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.395196 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.445369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:26.445962 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:26.459409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.459409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.459409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.459409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.561458 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:26.570138 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2e0f9d1e-86da-47ac-a8e5-1b5497e21a66 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.188150 Jan 21 13:50:26.580166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 303/611] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:26 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:26.616260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:26.624829 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3db26a70-b49b-4f09-a1fc-4938aaddb691 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.182905 Jan 21 13:50:26.625420 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 309/612] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:26 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:26.713452 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:26.714219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:26.721846 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.722292 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.723167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.723919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.781146 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:26.781788 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:26.787952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.788404 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.789262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:26.789731 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:26.883070 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:26.891782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:26.893438 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:26.894698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-729ed675-6efa-4a68-a820-01aae3e748d4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.185197 Jan 21 13:50:26.895576 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 304/613] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:26 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:26.949778 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:26.957122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-40c6ec44-de34-4ff3-b2a7-55bd1d5b165d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.180420 Jan 21 13:50:26.957690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 310/614] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:26 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:27.587173 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:27.587859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:27.594833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.595284 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:27.596059 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.596494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:27.642677 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:27.643402 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:27.649814 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.650368 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:27.651254 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.651763 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:27.747997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:27.756911 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-80f8aac8-1732-46cf-8df3-7e9d12dbd663 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.173295 Jan 21 13:50:27.760742 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 305/615] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:27 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:27.819144 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:27.830735 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ca29cda7-8e4e-4ef4-a7fb-caf95cdab795 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.192949 Jan 21 13:50:27.831542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 311/616] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:27 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:27.913475 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:27.914082 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:27.919954 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.920402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:27.921203 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.921635 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:27.974223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:27.975106 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:27.983345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.983889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:27.984936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:27.985444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:28.081720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:28.092737 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:28.095625 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:28.097533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0f8dcd6a-fb69-4e98-9a4c-cf738fb78474 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.187761 Jan 21 13:50:28.106079 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 306/617] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:27 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:28.140188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:28.147774 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b88446f6-2d44-4235-9c79-6065dab18a71 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.177451 Jan 21 13:50:28.148363 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 312/618] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:27 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:28.774125 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:28.774852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:28.782740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:28.783185 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:28.783964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:28.784391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:28.847542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:28.848135 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:28.854474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:28.854936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:28.855737 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:28.856178 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:28.917163 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:28.924588 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-facd0205-b70c-408b-bfff-157e1c1a4e19 tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.154078 Jan 21 13:50:28.925191 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 307/619] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:28 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:28.995759 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:29.003110 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-67cba3e5-b21f-4111-b8a0-facaeae10843 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.159291 Jan 21 13:50:29.003678 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 313/620] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:28 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:29.119337 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:29.119865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:29.126264 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:29.126715 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:29.127491 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:29.127930 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:29.165844 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:29.166451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:29.172847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:29.173300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:29.174082 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:29.174515 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:29.259924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:29.268850 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:29.270339 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:29.271509 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f2c86ac1-230a-4b1d-87b7-de86adc18d4d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.155976 Jan 21 13:50:29.272065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 308/621] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:29 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:29.308759 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:29.316418 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-38a7f73e-eaf9-4569-9595-c24978cb4c2d tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1507 microversion: 2.1 time: 0.154186 Jan 21 13:50:29.317045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 314/622] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:29 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:29.941261 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:29.941870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:29.948144 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:29.948591 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:29.949391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:29.949915 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.019984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:30.020565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:30.026856 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.027317 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.028206 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.028785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.086955 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:30.098366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-05826c76-76e1-4437-bb7c-4d772a77dd4d tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1512 microversion: 2.1 time: 0.160546 Jan 21 13:50:30.099010 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 309/623] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:29 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:30.204268 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-69a25c3f-ae5c-4ba3-a12b-a7085a84b272 req-4b576e60-9063-4bc1-a87f-38113d23f3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56e7904-e470-43e9-a035-27f2bc6ac74b", "name": "network-vif-deleted", "tag": "f0dbf2a1-2dd0-4ac6-989f-0d3217db9bc8"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:30.206163 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:30.206163 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:50:30.215155 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-69a25c3f-ae5c-4ba3-a12b-a7085a84b272 req-4b576e60-9063-4bc1-a87f-38113d23f3e6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.215642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-69a25c3f-ae5c-4ba3-a12b-a7085a84b272 req-4b576e60-9063-4bc1-a87f-38113d23f3e6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.234442 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-69a25c3f-ae5c-4ba3-a12b-a7085a84b272 req-4b576e60-9063-4bc1-a87f-38113d23f3e6 service nova] Creating event network-vif-deleted:f0dbf2a1-2dd0-4ac6-989f-0d3217db9bc8 for instance e56e7904-e470-43e9-a035-27f2bc6ac74b on hv-cinder-82016 Jan 21 13:50:30.239347 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-69a25c3f-ae5c-4ba3-a12b-a7085a84b272 req-4b576e60-9063-4bc1-a87f-38113d23f3e6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040994 Jan 21 13:50:30.239944 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 310/624] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:50:30.289584 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:30.290197 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:30.297695 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.298363 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.299368 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.300137 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.332714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:30.341471 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-12ff90c0-b289-4de5-a430-d95e95d815b2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.325230 Jan 21 13:50:30.342411 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 315/625] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:30 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:30.347251 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:30.348226 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:30.355935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.357407 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.358470 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.359123 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.394256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:30.394777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:30.395297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lazy-loading 'fault' on Instance uuid e56e7904-e470-43e9-a035-27f2bc6ac74b {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:50:30.448277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:30.453968 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:30.457208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:30.458885 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:30.460119 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9df091ce-371d-4ee5-b8f2-c86aa32d45a0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.174628 Jan 21 13:50:30.462214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 311/626] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:30 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:30.462358 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0dcf5872-049f-48d2-be4a-f0d3c4cbf332 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 200 len: 1311 microversion: 2.1 time: 0.117743 Jan 21 13:50:30.462358 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 316/627] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:30 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:31.115208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:31.115790 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:31.122216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.122663 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.123510 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.123854 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.157555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.158017 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.158535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lazy-loading 'fault' on Instance uuid d1f7e6fc-4849-4f12-bf71-4aada9d59f82 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:50:31.199888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef601f05ed04634bf325e21efbea29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bba285c3584d64b257d0800a59f0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:31.207823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3f23495d-1b86-43c0-88a8-ef4cb200ea8a tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 200 len: 1307 microversion: 2.1 time: 0.096405 Jan 21 13:50:31.208405 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 312/628] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:31 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:31.361620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:31.362230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:31.368884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.369273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.370048 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.370486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.478436 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:31.479041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: e56e7904-e470-43e9-a035-27f2bc6ac74b] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:31.484743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.485197 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.485973 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.486414 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.499781 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] HTTP exception thrown: Instance e56e7904-e470-43e9-a035-27f2bc6ac74b could not be found. Jan 21 13:50:31.500365 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Returning 404 to user: Instance e56e7904-e470-43e9-a035-27f2bc6ac74b could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:50:31.501211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-98d9e051-3cfc-4620-ab4e-3cbe8723d211 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b" status: 404 len: 111 microversion: 2.1 time: 0.026471 Jan 21 13:50:31.501752 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 313/629] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:31 2022] GET /compute/v2.1/servers/e56e7904-e470-43e9-a035-27f2bc6ac74b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:50:31.502581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:31.507108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:31.508559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:31.512322 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-55a37a97-db8a-4b07-a2a3-981547ce6659 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.154384 Jan 21 13:50:31.514247 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 317/630] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:31 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:31.514890 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.515347 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.516145 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.516587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.518983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:31.519666 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:31.526941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.527396 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.528183 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.528747 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.553013 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:50:31.631435 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3ccf5716-3dce-4808-827c-2e8150406692 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "DELETE /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 204 len: 0 microversion: 2.1 time: 0.115553 Jan 21 13:50:31.632566 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 318/631] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:50:31 2022] DELETE /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:50:31.641847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:31.642545 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:31.648254 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.648694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.649462 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:31.649900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:31.651243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:31.659775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:31.661400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:31.662617 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e6863a95-983d-40e8-87c2-2f672f48889a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.159102 Jan 21 13:50:31.663354 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 314/632] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:31 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:31.795714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:31.802858 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e49cd29d-69c6-4f9a-88b6-b288c7de1a3f tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.166297 Jan 21 13:50:31.803421 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 319/633] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:31 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:32.225224 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:32.225837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] [instance: d1f7e6fc-4849-4f12-bf71-4aada9d59f82] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:32.232133 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.232579 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.233369 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.233832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.246265 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] HTTP exception thrown: Instance d1f7e6fc-4849-4f12-bf71-4aada9d59f82 could not be found. Jan 21 13:50:32.246832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] Returning 404 to user: Instance d1f7e6fc-4849-4f12-bf71-4aada9d59f82 could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:50:32.248165 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-51d5e1ce-b228-4de9-ac85-de63c7351b3b tempest-AttachVolumeNegativeTest-1499903757 tempest-AttachVolumeNegativeTest-1499903757-project] 10.222.0.84 "GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82" status: 404 len: 111 microversion: 2.1 time: 0.026611 Jan 21 13:50:32.248692 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 315/634] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:32 2022] GET /compute/v2.1/servers/d1f7e6fc-4849-4f12-bf71-4aada9d59f82 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:50:32.265777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-ea4ca6e8-9f51-4462-a414-5227c1c8f007 req-164d8438-ce4c-4f74-8b74-efae9706c151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f7e6fc-4849-4f12-bf71-4aada9d59f82", "name": "network-vif-deleted", "tag": "50c7d8b5-1947-463c-a58a-50b21faf13db"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:32.267564 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:32.267564 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:50:32.274414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ea4ca6e8-9f51-4462-a414-5227c1c8f007 req-164d8438-ce4c-4f74-8b74-efae9706c151 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.274859 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ea4ca6e8-9f51-4462-a414-5227c1c8f007 req-164d8438-ce4c-4f74-8b74-efae9706c151 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.285885 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-ea4ca6e8-9f51-4462-a414-5227c1c8f007 req-164d8438-ce4c-4f74-8b74-efae9706c151 service nova] Creating event network-vif-deleted:50c7d8b5-1947-463c-a58a-50b21faf13db for instance d1f7e6fc-4849-4f12-bf71-4aada9d59f82 on hv-cinder-82016 Jan 21 13:50:32.290729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-ea4ca6e8-9f51-4462-a414-5227c1c8f007 req-164d8438-ce4c-4f74-8b74-efae9706c151 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029334 Jan 21 13:50:32.291359 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 320/635] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:32.531073 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:32.531695 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:32.537785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.538236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.539223 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.539661 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.683043 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:32.684126 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:32.690947 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.691466 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.692268 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.692739 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.798467 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:32.806058 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-23987815-cee8-4159-8fee-3212fbbe3c73 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.279560 Jan 21 13:50:32.806630 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 316/636] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:32 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:32.820477 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:32.821806 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:32.829692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:32.834514 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.835178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.836161 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:32.836630 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:32.840213 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:32.842591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:32.843782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-87736e11-d916-4d8d-be9d-2ecff0ae4e8a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.166960 Jan 21 13:50:32.844741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 321/637] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:32 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:32.985300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:32.993898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8bcd6cb8-f665-49d6-8f2a-68761565112a tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.176825 Jan 21 13:50:32.994580 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 317/638] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:32 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:33.822820 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:33.823461 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:33.831091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:33.831547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:33.832323 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:33.832789 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:33.866913 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:33.867598 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:33.878705 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:33.879243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:33.880079 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:33.880708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:33.986143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:33.993345 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-981e786f-f8f8-40d7-a567-a1c3696cd7fa tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.174061 Jan 21 13:50:33.993919 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 322/639] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:33 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:34.010780 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:34.011355 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:34.018667 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:34.019116 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:34.019904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:34.020342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:34.034060 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:34.042386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:34.043824 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:34.045752 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-df147df3-d47a-453b-b62e-607f5306e8c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.182465 Jan 21 13:50:34.046314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 318/640] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:33 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:34.158706 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:34.166943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c134ea6d-5d03-4c3d-a0b5-6e7d77be3204 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.159704 Jan 21 13:50:34.167605 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 323/641] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:34 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:34.619301 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-e1b1025f-5125-4773-8750-0196925cd80e req-3d9aaa85-757f-4a69-b8df-46043689e6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591899e6-cf08-42d3-9b97-59bfd88f7fa6", "name": "network-vif-plugged", "status": "completed", "tag": "40372efa-3a9e-443e-a378-7289829a045d"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:34.621659 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:34.621659 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:50:34.631412 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-e1b1025f-5125-4773-8750-0196925cd80e req-3d9aaa85-757f-4a69-b8df-46043689e6ae service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:34.631856 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-e1b1025f-5125-4773-8750-0196925cd80e req-3d9aaa85-757f-4a69-b8df-46043689e6ae service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:34.642849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-e1b1025f-5125-4773-8750-0196925cd80e req-3d9aaa85-757f-4a69-b8df-46043689e6ae service nova] Creating event network-vif-plugged:40372efa-3a9e-443e-a378-7289829a045d for instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 on hv-cinder-82016 Jan 21 13:50:34.647914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-e1b1025f-5125-4773-8750-0196925cd80e req-3d9aaa85-757f-4a69-b8df-46043689e6ae service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033461 Jan 21 13:50:34.648568 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 319/642] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:35.011507 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:35.012497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:35.020701 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:35.021337 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:35.022395 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:35.023091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:35.065742 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:35.067904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:35.077022 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:35.077481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:35.078283 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:35.078725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:35.188165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:35.195996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f146e5ab-4184-4959-a7ea-86fc2d8f6e87 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.188145 Jan 21 13:50:35.197061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 324/643] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:35 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:35.203126 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:35.203741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:35.209684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:35.210143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:35.210935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:35.211370 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:35.225980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:35.234817 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:35.236967 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:35.238381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0b621567-8274-4f10-990e-7ab08af3ad8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.178519 Jan 21 13:50:35.238955 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 320/644] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:35 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:35.351192 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:35.358898 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-80200a69-6326-4e5a-8878-d999a20596df tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.160775 Jan 21 13:50:35.359484 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 325/645] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:35 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:35.364908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-12e15ae4-09e9-4f23-9876-fbb1e6a03311 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6c34280>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:35.415290 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-12e15ae4-09e9-4f23-9876-fbb1e6a03311 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/c76fb100-557d-4d89-9637-c7ea738a8946" status: 200 len: 351 microversion: 2.1 time: 0.053890 Jan 21 13:50:35.415864 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 321/646] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:50:35 2022] GET /compute/v2.1/os-volumes/c76fb100-557d-4d89-9637-c7ea738a8946 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:36.214916 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:36.215568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:36.222573 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:36.223019 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:36.223786 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:36.224217 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:36.259713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:36.260350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:36.271833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:36.272656 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:36.273784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:36.274522 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:36.375736 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:36.383427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1a28f0f7-fda4-44e9-aab9-98081bed0b15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1260 microversion: 2.1 time: 0.172002 Jan 21 13:50:36.384348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 326/647] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:36 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:36.389915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:36.390522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:36.396693 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:36.397150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:36.397935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:36.398370 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:36.410967 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:36.419388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:36.420942 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:36.422118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-324f0cdc-210f-4335-8ac5-d9759b337141 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.166773 Jan 21 13:50:36.422679 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 322/648] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:36 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:36.531140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:36.538370 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fcb6077a-ca06-4437-b0ff-a5c17660a8d8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.153028 Jan 21 13:50:36.538932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 327/649] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:36 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:36.716545 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-15979565-38e1-4817-8541-390f9c0e2a55 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6c34f70>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:36.761244 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-15979565-38e1-4817-8541-390f9c0e2a55 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/46bf8e8e-2cc0-4f18-a0a1-56e4527b08af" status: 200 len: 351 microversion: 2.1 time: 0.048431 Jan 21 13:50:36.761800 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 323/650] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:50:36 2022] GET /compute/v2.1/os-volumes/46bf8e8e-2cc0-4f18-a0a1-56e4527b08af => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:37.400988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:37.401607 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:37.408093 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.408539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.409408 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.409847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.439515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:37.440134 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:37.446738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.447195 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.447978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.448417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.539783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:37.547392 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-281b04cf-7f50-4c32-b39d-cbff16dfcd98 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1443 microversion: 2.1 time: 0.149961 Jan 21 13:50:37.548052 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 328/651] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:37 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:37.554850 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:37.555452 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:37.561758 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.562200 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.562976 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.563414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.580644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:37.588803 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:37.590320 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:37.592039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-48d03ca1-76a5-46e0-beb5-25ed594aa887 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.156222 Jan 21 13:50:37.592600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 324/652] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:37 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:50:37.596832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:37.597447 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:37.603277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.603735 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.604520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:37.604991 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:37.696591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:37.704635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e6059971-5322-41bf-a4e0-e817f5c0ff54 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1523 microversion: 2.1 time: 0.153236 Jan 21 13:50:37.705314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 329/653] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:37 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:37.735488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:37.743701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6ef81ca5-7a45-4511-b81f-85bcca574573 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1443 microversion: 2.1 time: 0.150132 Jan 21 13:50:37.744270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 325/654] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:37 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:38.061965 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0ea4cd6c-c40e-45bd-b351-3213d09b7a6c tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6df01f0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.109104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0ea4cd6c-c40e-45bd-b351-3213d09b7a6c tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/9a5c5b24-505d-44f2-9856-f2aaaa098422" status: 200 len: 351 microversion: 2.1 time: 0.051167 Jan 21 13:50:38.112901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 330/655] 10.222.0.84 () {58 vars in 1244 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes/9a5c5b24-505d-44f2-9856-f2aaaa098422 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:38.120686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3c32324b-7284-4c6e-af71-c8b3017971cb tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6c68160>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.198722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3c32324b-7284-4c6e-af71-c8b3017971cb tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081646 Jan 21 13:50:38.199293 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 326/656] 10.222.0.84 () {58 vars in 1133 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:38.211240 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-85f24f62-392a-4e35-bb01-1a935adc2d7d tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6de6430>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.290576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-85f24f62-392a-4e35-bb01-1a935adc2d7d tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082897 Jan 21 13:50:38.291148 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 331/657] 10.222.0.84 () {58 vars in 1148 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:38.305339 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7143a382-6704-4aba-a31e-fcfc6cd69f42 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6c348b0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.386794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7143a382-6704-4aba-a31e-fcfc6cd69f42 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086711 Jan 21 13:50:38.387281 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 327/658] 10.222.0.84 () {58 vars in 1133 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:38.398542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0d787fd3-08de-4318-932c-86cf8f72f1ee tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6dfb940>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.488943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0d787fd3-08de-4318-932c-86cf8f72f1ee tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094062 Jan 21 13:50:38.489519 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 332/659] 10.222.0.84 () {58 vars in 1166 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:50:38.500893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1c65729b-baea-44a1-9218-08c503d055bf tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6c325e0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.592695 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1c65729b-baea-44a1-9218-08c503d055bf tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.095334 Jan 21 13:50:38.594162 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 328/660] 10.222.0.84 () {58 vars in 1169 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:38.610211 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cdbfc3b8-b058-4d0a-a2fa-6438c4ae0661 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6dfb5e0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.615620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.617121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:38.626983 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:38.627451 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:38.628257 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:38.628762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:38.760868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cdbfc3b8-b058-4d0a-a2fa-6438c4ae0661 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.155553 Jan 21 13:50:38.761879 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 333/661] 10.222.0.84 () {58 vars in 1154 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:38.772448 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.773496 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:38.796760 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:38.799709 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:38.802769 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:38.808165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:38.884648 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8122bf15cfa8466db22e7046a22c1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b530f15584103a5bf73d0a63e801d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:38.894596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d8ed530f-1cf3-4fcf-af98-3c367c1b4ad8 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 200 len: 1481 microversion: 2.1 time: 0.131537 Jan 21 13:50:38.895456 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 334/662] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 1481 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:38.901799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-87aa3ef5-418f-40b2-9b86-74afe55da5d2 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6e7a820>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:38.975561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:38.986457 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:38.988935 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:38.991271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-748ec3f5-0fda-4f2f-b7c9-8cd3e7d4894f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.382738 Jan 21 13:50:38.992896 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 329/663] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:39.001562 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-0740c1af-a0e6-4c9e-9fe0-bd08a16ac74b req-3fa36cf1-fba4-4871-9260-8346f6e7c395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12549874-6848-4a56-b964-807011e2d9be", "name": "network-vif-deleted", "tag": "43e5e65d-1f21-4eef-8f7d-fc14bde05f74"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:39.005093 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:39.005093 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:50:39.014381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-0740c1af-a0e6-4c9e-9fe0-bd08a16ac74b req-3fa36cf1-fba4-4871-9260-8346f6e7c395 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:39.015245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-0740c1af-a0e6-4c9e-9fe0-bd08a16ac74b req-3fa36cf1-fba4-4871-9260-8346f6e7c395 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:39.029122 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-0740c1af-a0e6-4c9e-9fe0-bd08a16ac74b req-3fa36cf1-fba4-4871-9260-8346f6e7c395 service nova] Creating event network-vif-deleted:43e5e65d-1f21-4eef-8f7d-fc14bde05f74 for instance 12549874-6848-4a56-b964-807011e2d9be on hv-cinder-82016 Jan 21 13:50:39.030045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-87aa3ef5-418f-40b2-9b86-74afe55da5d2 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.133285 Jan 21 13:50:39.030698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 335/664] 10.222.0.84 () {58 vars in 1187 bytes} [Fri Jan 21 13:50:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:39.037263 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-0740c1af-a0e6-4c9e-9fe0-bd08a16ac74b req-3fa36cf1-fba4-4871-9260-8346f6e7c395 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039943 Jan 21 13:50:39.039199 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 330/665] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:39.044440 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a721f075-2ea5-4178-8a41-e8e900575cd2 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] Calling method '.version_select at 0x7f51b6c68280>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:39.045298 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d25200ee-ef5d-4410-9e89-0dbeba9a65d0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:39.046242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d25200ee-ef5d-4410-9e89-0dbeba9a65d0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:39.054065 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d25200ee-ef5d-4410-9e89-0dbeba9a65d0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:39.054524 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d25200ee-ef5d-4410-9e89-0dbeba9a65d0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:39.055326 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d25200ee-ef5d-4410-9e89-0dbeba9a65d0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:39.055768 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d25200ee-ef5d-4410-9e89-0dbeba9a65d0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:39.128371 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a721f075-2ea5-4178-8a41-e8e900575cd2 tempest-VolumesTestJSON-835365933 tempest-VolumesTestJSON-835365933-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087885 Jan 21 13:50:39.129355 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 331/666] 10.222.0.84 () {58 vars in 1154 bytes} [Fri Jan 21 13:50:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:39.149555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d25200ee-ef5d-4410-9e89-0dbeba9a65d0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.110769 Jan 21 13:50:39.150223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 336/667] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:50:39 2022] POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:50:39.159020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:39.159841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:39.165964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:39.166837 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:39.167783 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:39.168376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:39.482845 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:39.492384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-411df665-372b-4277-b9db-7e30dbd5672c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1747 microversion: 2.1 time: 0.336758 Jan 21 13:50:39.493368 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 332/668] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:39 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1747 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:39.914777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:39.915481 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] [instance: 12549874-6848-4a56-b964-807011e2d9be] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:39.922690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:39.923170 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:39.924149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:39.924592 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:39.939117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] HTTP exception thrown: Instance 12549874-6848-4a56-b964-807011e2d9be could not be found. Jan 21 13:50:39.939716 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] Returning 404 to user: Instance 12549874-6848-4a56-b964-807011e2d9be could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:50:39.940544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3ed83280-8c48-4b3f-8398-4de471efb784 tempest-ServerRescueNegativeTestJSON-154812717 tempest-ServerRescueNegativeTestJSON-154812717-project] 10.222.0.84 "GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be" status: 404 len: 111 microversion: 2.1 time: 0.031259 Jan 21 13:50:39.941126 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 337/669] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:39 2022] GET /compute/v2.1/servers/12549874-6848-4a56-b964-807011e2d9be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:50:40.012166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:40.013730 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:40.020185 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:40.020657 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:40.021446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:40.021884 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:40.347473 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:40.359197 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-11d8f9a1-d8c9-4b1f-a08b-3d0c71d70c2a req-f7df045d-2651-4f05-ac1e-3efad8804976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591899e6-cf08-42d3-9b97-59bfd88f7fa6", "tag": "40372efa-3a9e-443e-a378-7289829a045d"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:40.361003 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:40.361003 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:50:40.371674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:40.374868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-11d8f9a1-d8c9-4b1f-a08b-3d0c71d70c2a req-f7df045d-2651-4f05-ac1e-3efad8804976 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:40.375084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:40.375793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-11d8f9a1-d8c9-4b1f-a08b-3d0c71d70c2a req-f7df045d-2651-4f05-ac1e-3efad8804976 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:40.376561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-719b7d6d-eb7e-4c4b-a4f0-09711c4c44b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.369119 Jan 21 13:50:40.387747 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 333/670] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:40 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:40.402171 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-11d8f9a1-d8c9-4b1f-a08b-3d0c71d70c2a req-f7df045d-2651-4f05-ac1e-3efad8804976 service nova] Creating event network-changed:40372efa-3a9e-443e-a378-7289829a045d for instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 on hv-cinder-82016 Jan 21 13:50:40.408676 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-11d8f9a1-d8c9-4b1f-a08b-3d0c71d70c2a req-f7df045d-2651-4f05-ac1e-3efad8804976 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052669 Jan 21 13:50:40.409500 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 338/671] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:50:40.511536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:40.512456 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:40.521688 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:40.526799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:40.527748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:40.529387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:40.717456 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-79382efe-ff26-4def-b564-a0b01e7baee6 req-c1fbc6bb-a531-4394-8b25-5b7e5c305ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade", "name": "network-vif-plugged", "status": "completed", "tag": "13e896be-af8b-4c5b-b2fe-cd245c3385d1"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:50:40.720839 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:50:40.720839 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:50:40.732138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-79382efe-ff26-4def-b564-a0b01e7baee6 req-c1fbc6bb-a531-4394-8b25-5b7e5c305ebd service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:40.732873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-79382efe-ff26-4def-b564-a0b01e7baee6 req-c1fbc6bb-a531-4394-8b25-5b7e5c305ebd service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:40.744906 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-79382efe-ff26-4def-b564-a0b01e7baee6 req-c1fbc6bb-a531-4394-8b25-5b7e5c305ebd service nova] Creating event network-vif-plugged:13e896be-af8b-4c5b-b2fe-cd245c3385d1 for instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade on hv-cinder-82016 Jan 21 13:50:40.751596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-79382efe-ff26-4def-b564-a0b01e7baee6 req-c1fbc6bb-a531-4394-8b25-5b7e5c305ebd service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039035 Jan 21 13:50:40.753563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 339/672] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:50:40.859076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:40.867041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-63a4fac5-e9cc-40b2-a257-cdd233d68a2c tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.359208 Jan 21 13:50:40.878146 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 334/673] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:40 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:41.396170 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:41.396900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:41.405232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:41.406264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:41.407059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:41.407492 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:41.574315 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:41.583714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:41.586402 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:41.586703 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f7bc2441-782c-4360-99dd-82a9a05f924a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.195118 Jan 21 13:50:41.587495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 340/674] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:41 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:41.885253 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:41.885866 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:41.892323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:41.892814 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:41.893630 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:41.894077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:42.143357 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:42.151202 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fe196726-2979-4ea2-a950-bc6e9d947624 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.269610 Jan 21 13:50:42.151789 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 335/675] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:41 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:42.604801 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:42.610277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:42.629276 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:42.630087 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:42.631098 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:42.633909 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:42.873664 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:42.894660 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:42.900036 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:42.910237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-566066cb-e069-45a3-8d33-e3f29c8e9cd2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1809 microversion: 2.20 time: 0.309144 Jan 21 13:50:42.917382 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 341/676] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:42 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:43.172863 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:43.174008 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:43.181320 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:43.181852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:43.182851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:43.183449 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:43.448232 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:43.465130 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1d6166fd-beab-4117-918e-bfefb9583dc9 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.299261 Jan 21 13:50:43.466931 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 336/677] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:43 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:50:43.935468 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:43.937263 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:43.957224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:43.957813 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:43.961921 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:43.962963 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:44.192463 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:44.202341 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:44.204142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:44.206212 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0034738a-c33e-4b89-8b54-42fc2958222d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1796 microversion: 2.20 time: 0.274815 Jan 21 13:50:44.223554 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 342/678] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:50:43 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1796 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:50:44.483250 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:44.484466 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:44.491033 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:44.491467 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:44.492260 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:44.492730 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:44.671740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:44.680254 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bd6659b2-b5e6-46d3-a0ef-5ea64d1d141e tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.200802 Jan 21 13:50:44.680852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 337/679] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:44 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:45.702611 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:45.704005 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:45.710365 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:45.711021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:45.711964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:45.712553 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:45.900791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:45.909997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e572cd8e-c07b-4375-ae3b-0c08a7329eaf tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.212548 Jan 21 13:50:45.910819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 343/680] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:45 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:46.926975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:46.927789 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:46.934549 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:46.935005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:46.935880 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:46.936453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:47.083056 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:47.091596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8ab2cf1d-7465-4c38-bc1b-a2da6a7049fe tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.168326 Jan 21 13:50:47.092263 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 338/681] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:46 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:48.109198 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:48.109817 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:48.117440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:48.117968 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:48.118853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:48.119521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:48.267445 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:48.275946 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2605c717-404c-4040-a527-ab5235f3fc91 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.171324 Jan 21 13:50:48.276542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 344/682] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:48 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:49.293790 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:49.294442 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:49.300797 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:49.301249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:49.302027 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:49.302462 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:49.448958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:49.459197 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ac0c5365-c3d6-4040-add6-0e8f0eba01d6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.168911 Jan 21 13:50:49.461591 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 339/683] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:49 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:50.477018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:50.477643 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:50.485152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:50.485607 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:50.486396 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:50.486831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:50.639314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:50.648030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-443a53e0-4bb9-4c8f-9d93-6f22267c14ac tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.174568 Jan 21 13:50:50.648708 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 345/684] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:50 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:51.665333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:51.665950 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:51.672907 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:51.673360 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:51.674137 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:51.674576 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:51.828023 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:51.835652 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-191ba0d0-04e7-4c15-97d3-3d4ea06ac471 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1752 microversion: 2.1 time: 0.174019 Jan 21 13:50:51.836216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 340/685] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:51 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:50:52.853833 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:50:52.854443 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:50:52.862265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:52.862985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:52.864035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:50:52.864648 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:50:53.025012 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:50:53.033424 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-58f5deca-8e87-481b-917a-b23078a02131 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1755 microversion: 2.1 time: 0.183679 Jan 21 13:50:53.034041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 346/686] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:50:52 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:08.263234 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:08.263826 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:08.270375 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:08.270898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:08.271764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:08.272204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:08.360872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lazy-loading 'services' on Instance uuid e59552fe-d2ae-43ad-bf63-f4d6958c05fc {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:51:08.427430 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a3471d73-36c3-4308-9518-2df4723660f3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-volume_attachments/5fdfafee-4d84-47a3-b296-42e74e38eb2c" status: 202 len: 0 microversion: 2.1 time: 0.168544 Jan 21 13:51:08.428009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 341/687] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:51:08 2022] DELETE /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-volume_attachments/5fdfafee-4d84-47a3-b296-42e74e38eb2c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:51:09.557348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de639b2d-a395-471f-9d71-6e0a0dfa1143 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:09.565377 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de639b2d-a395-471f-9d71-6e0a0dfa1143 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:09.566035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de639b2d-a395-471f-9d71-6e0a0dfa1143 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:09.629434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de639b2d-a395-471f-9d71-6e0a0dfa1143 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Going to try to stop instance {{(pid=122814) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 21 13:51:09.672440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de639b2d-a395-471f-9d71-6e0a0dfa1143 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 202 len: 0 microversion: 2.1 time: 0.118663 Jan 21 13:51:09.673115 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 347/688] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:51:09 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:51:09.682626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:09.683319 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:09.690109 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:09.690559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:09.691504 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:09.691918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:09.829250 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:09.837026 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e7174b1c-0b5e-42ed-a11f-e73e38fd364d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.159465 Jan 21 13:51:09.837583 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 342/689] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:09 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:10.856070 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:10.856926 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:10.863102 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:10.863545 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:10.864319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:10.864792 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:11.000705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:11.008051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-62fa39be-7b56-46d9-a47c-7e6da842ec21 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.156486 Jan 21 13:51:11.008629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 348/690] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:10 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:12.026045 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:12.026663 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:12.033407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:12.033866 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:12.034784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:12.035297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:12.165387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:12.173327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-aba63976-77a9-42c5-8a3f-c040706f82d0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.150910 Jan 21 13:51:12.173906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 343/691] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:12 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:13.190242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:13.190944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:13.197311 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:13.197835 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:13.198683 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:13.199300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:13.338466 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:13.346919 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-eef0b27c-5dd2-4c2b-b386-977c7f383baa tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.160167 Jan 21 13:51:13.356451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 349/692] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:13 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:14.363824 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:14.364443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:14.371167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:14.371636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:14.372450 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:14.372934 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:14.515842 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:14.533743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-36f3001a-cf91-49e3-8673-5210b64bd05f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.173460 Jan 21 13:51:14.534339 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 344/693] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:14 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:15.550519 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:15.551149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:15.557080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:15.557530 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:15.558302 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:15.558742 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:15.688547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:15.695691 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a4fd0605-5c90-4003-9d8d-a92154f232b0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.148765 Jan 21 13:51:15.696264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 350/694] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:15 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:16.712996 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:16.713605 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:16.719803 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:16.720256 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:16.721072 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:16.721511 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:16.847367 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:16.854718 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-addb87b8-ce0b-4ac4-9f18-ad157eec191f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.145379 Jan 21 13:51:16.855295 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 345/695] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:16 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:17.872600 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:17.873771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:17.880890 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:17.881336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:17.882161 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:17.882595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:18.019674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:18.027085 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-aa8bbd5b-46bc-428a-8b95-a86ddfff2092 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.158052 Jan 21 13:51:18.027877 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 351/696] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:17 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:51:19.045435 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:19.046334 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:19.052665 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:19.053123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:19.053940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:19.054381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:19.189150 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:19.196299 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8111fc26-b955-4971-9c33-68259c527626 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.155002 Jan 21 13:51:19.196894 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 346/697] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:19 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:20.213837 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:20.214396 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:20.220889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:20.221331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:20.222114 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:20.222556 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:20.350146 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:20.358054 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a183bc9f-c468-44a2-a912-8d7a144b3177 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.147359 Jan 21 13:51:20.359164 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 352/698] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:20 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:21.375691 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:21.376289 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:21.382525 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:21.382970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:21.383738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:21.384169 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:21.511304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:21.518779 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ab57ce32-87df-44f8-9bbf-352066374228 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.147476 Jan 21 13:51:21.519358 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 347/699] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:21 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:22.537619 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:22.538231 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:22.544632 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:22.545097 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:22.546637 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:22.547323 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:22.702996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:22.710286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2cd6ac16-e476-4daa-901e-eea357c774af tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.177297 Jan 21 13:51:22.710861 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 353/700] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:22 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:23.733650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:23.734441 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:23.741210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:23.741801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:23.742666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:23.743177 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:23.968952 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:23.976643 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-de168d38-c3cb-4a16-86f0-6f6a89126323 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.246895 Jan 21 13:51:23.977417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 348/701] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:23 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:24.994564 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:24.995250 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:25.003184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:25.003795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:25.004729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:25.005288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:25.206244 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:25.214127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0b24fc53-ba6b-48f5-a705-0decaf122bf6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1676 microversion: 2.1 time: 0.223488 Jan 21 13:51:25.214944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 354/702] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:24 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:26.232479 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:26.233360 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:26.239515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:26.240310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:26.241219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:26.241654 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:26.419461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:26.445282 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6e3bd7da-ac8e-4c80-ad8f-1a37803fb6ab tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1653 microversion: 2.1 time: 0.215075 Jan 21 13:51:26.446883 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 349/703] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:26 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1653 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:26.463495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6fd5a9f5-e49f-4460-a18a-5a0e9ca5812f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:26.470348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6fd5a9f5-e49f-4460-a18a-5a0e9ca5812f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:26.471029 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6fd5a9f5-e49f-4460-a18a-5a0e9ca5812f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:26.495313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6fd5a9f5-e49f-4460-a18a-5a0e9ca5812f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Going to try to start instance {{(pid=122814) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 21 13:51:26.541789 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6fd5a9f5-e49f-4460-a18a-5a0e9ca5812f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action" status: 202 len: 0 microversion: 2.1 time: 0.081716 Jan 21 13:51:26.542795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 355/704] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:51:26 2022] POST /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:51:26.551246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:26.551862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:26.560751 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:26.561429 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:26.562844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:26.563360 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:26.783769 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:26.793658 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5e9c243d-7c0c-4dfb-88df-9c2ea4de003c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1662 microversion: 2.1 time: 0.246396 Jan 21 13:51:26.794231 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 350/705] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:26 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1662 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:27.813000 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:27.813693 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:27.819648 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:27.820089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:27.820886 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:27.821331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:27.955545 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:27.962736 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7769d97a-9ac5-4a4b-8a1b-1ef8add16b2b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1662 microversion: 2.1 time: 0.155092 Jan 21 13:51:27.963299 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 356/706] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:27 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:28.980103 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:28.980700 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:28.987781 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:28.988236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:28.989044 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:28.989481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:29.119218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:29.126394 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5a93bb86-a564-409b-a2be-2ece60ec1e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1662 microversion: 2.1 time: 0.150277 Jan 21 13:51:29.126968 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 351/707] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:28 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:30.143542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:30.144142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:30.150397 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:30.150846 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:30.151611 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:30.152038 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:30.283932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:30.291214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cfa81548-9201-4b68-b8ec-d428223a24c7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1662 microversion: 2.1 time: 0.151384 Jan 21 13:51:30.291780 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 357/708] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:30 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:30.463062 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-141651856", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "e3dbfaec-8cf8-41d4-873a-645beebf0141"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:30.516641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] validate_networks() for [('e3dbfaec-8cf8-41d4-873a-645beebf0141', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:51:30.863445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:51:30.863855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:51:30.864331 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:51:30.864776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:51:30.865182 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:51:30.873511 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:30.873992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:30.874799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:30.875227 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:30.891735 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Getting quotas for project f557e160058a4541b3abde466bd06c34. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:51:30.895532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Getting quotas for user b117cac4191e4366872cd1d1cee4087c and project f557e160058a4541b3abde466bd06c34. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:51:30.907423 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:51:30.910048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:51:30.954213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7457108b-2629-4b51-9351-d134d88801f8 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494686 Jan 21 13:51:30.954774 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 352/709] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:51:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:51:30.965018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-41fd083d-89ec-4809-90e9-94873ffbff90 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:30.965922 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-41fd083d-89ec-4809-90e9-94873ffbff90 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:31.021934 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-41fd083d-89ec-4809-90e9-94873ffbff90 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:31.031012 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-41fd083d-89ec-4809-90e9-94873ffbff90 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1218 microversion: 2.1 time: 0.068850 Jan 21 13:51:31.040589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 358/710] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:30 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:51:31.309032 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:31.309649 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:31.316629 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:31.317166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:31.317897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:31.318335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:31.456331 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:31.463561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-dc3b0ec3-c3ee-4e57-9bc7-b6c28fba372b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1666 microversion: 2.1 time: 0.158160 Jan 21 13:51:31.464178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 353/711] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:31 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:32.047311 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:32.048790 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:32.056356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:32.057281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:32.059198 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:32.059981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:32.169723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:32.177791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9f28d8ab-c921-4f48-b55f-4e704fadbef5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1288 microversion: 2.1 time: 0.134368 Jan 21 13:51:32.178454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 359/712] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:32 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1288 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:33.195015 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:33.195631 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:33.202135 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:33.202589 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:33.204083 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:33.204537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:33.341530 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:33.349386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b0d85d45-4a2c-4ced-be56-fce96bde01b7 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1318 microversion: 2.1 time: 0.158203 Jan 21 13:51:33.349962 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 354/713] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:33 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:33.506011 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-fa7f3bba-64bc-44a7-b980-686d5403a66d req-5c9e70b7-2b7a-4528-819b-c179fbd1989a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4640e25e-e213-4542-9654-2e83e6695ae3", "tag": "eced43b6-af89-450c-850c-098b515fc717"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:33.507735 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:33.507735 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:51:33.517794 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-fa7f3bba-64bc-44a7-b980-686d5403a66d req-5c9e70b7-2b7a-4528-819b-c179fbd1989a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:33.518444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-fa7f3bba-64bc-44a7-b980-686d5403a66d req-5c9e70b7-2b7a-4528-819b-c179fbd1989a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:33.530304 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-fa7f3bba-64bc-44a7-b980-686d5403a66d req-5c9e70b7-2b7a-4528-819b-c179fbd1989a service nova] Creating event network-changed:eced43b6-af89-450c-850c-098b515fc717 for instance 4640e25e-e213-4542-9654-2e83e6695ae3 on hv-cinder-82016 Jan 21 13:51:33.536066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-fa7f3bba-64bc-44a7-b980-686d5403a66d req-5c9e70b7-2b7a-4528-819b-c179fbd1989a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034279 Jan 21 13:51:33.537366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 360/714] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:34.366702 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:34.367424 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:34.373971 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:34.374503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:34.376435 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:34.377161 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:34.563246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:34.573737 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-fa5272ae-dba4-4fce-bdb0-b96b4cdf2237 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1318 microversion: 2.1 time: 0.211140 Jan 21 13:51:34.574330 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 355/715] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:34 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:35.591686 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:35.592463 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:35.598652 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:35.599181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:35.600056 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:35.600497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:35.737824 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:35.745123 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b7e26152-4ab2-48ca-9969-49c72d5ce8fa tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1318 microversion: 2.1 time: 0.158338 Jan 21 13:51:35.745696 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 361/716] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:35 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:35.970248 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9824b4c0-3d41-4800-93a5-86f6639de936 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:35.970855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9824b4c0-3d41-4800-93a5-86f6639de936 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:35.977045 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9824b4c0-3d41-4800-93a5-86f6639de936 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:35.977497 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9824b4c0-3d41-4800-93a5-86f6639de936 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:35.978274 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9824b4c0-3d41-4800-93a5-86f6639de936 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:35.978712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9824b4c0-3d41-4800-93a5-86f6639de936 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:36.007865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9824b4c0-3d41-4800-93a5-86f6639de936 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments/e9bf889e-5ee5-47a9-8841-7ee5d3ac8b91" status: 200 len: 194 microversion: 2.20 time: 0.042246 Jan 21 13:51:36.008459 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 356/717] 10.222.0.84 () {60 vars in 1453 bytes} [Fri Jan 21 13:51:35 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments/e9bf889e-5ee5-47a9-8841-7ee5d3ac8b91 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:51:36.076122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:36.076637 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:36.086689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:36.087142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:36.087929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:36.088367 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:36.175142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lazy-loading 'services' on Instance uuid 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:51:36.245076 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8df63e9d-9541-4651-8433-a2763e33e795 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments/e9bf889e-5ee5-47a9-8841-7ee5d3ac8b91" status: 202 len: 0 microversion: 2.20 time: 0.172702 Jan 21 13:51:36.245665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 362/718] 10.222.0.84 () {60 vars in 1456 bytes} [Fri Jan 21 13:51:36 2022] DELETE /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments/e9bf889e-5ee5-47a9-8841-7ee5d3ac8b91 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:51:36.254549 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e4ddd0b0-c5d7-45a6-858d-1cef2a839cae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:36.255551 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e4ddd0b0-c5d7-45a6-858d-1cef2a839cae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:36.261511 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4ddd0b0-c5d7-45a6-858d-1cef2a839cae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:36.261961 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4ddd0b0-c5d7-45a6-858d-1cef2a839cae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:36.262887 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4ddd0b0-c5d7-45a6-858d-1cef2a839cae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:36.263354 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4ddd0b0-c5d7-45a6-858d-1cef2a839cae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:36.293583 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e4ddd0b0-c5d7-45a6-858d-1cef2a839cae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043144 Jan 21 13:51:36.294153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 357/719] 10.222.0.84 () {60 vars in 1342 bytes} [Fri Jan 21 13:51:36 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:51:36.763427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:36.764127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:36.770808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:36.771303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:36.772795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:36.773303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:36.917895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:36.925842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e34fcb9f-6484-4818-a3e4-12ed18f88de2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1318 microversion: 2.1 time: 0.167057 Jan 21 13:51:36.926420 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 363/720] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:36 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:37.306284 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-197ef819-8328-4496-a591-1b103e4b3265 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:37.307197 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-197ef819-8328-4496-a591-1b103e4b3265 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:37.315074 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-197ef819-8328-4496-a591-1b103e4b3265 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.315530 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-197ef819-8328-4496-a591-1b103e4b3265 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:37.316326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-197ef819-8328-4496-a591-1b103e4b3265 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.316796 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-197ef819-8328-4496-a591-1b103e4b3265 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:37.350775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-197ef819-8328-4496-a591-1b103e4b3265 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048278 Jan 21 13:51:37.351362 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 358/721] 10.222.0.84 () {60 vars in 1342 bytes} [Fri Jan 21 13:51:37 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:37.407386 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:37.407879 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:37.413892 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.414538 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:37.415323 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.415767 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:37.441321 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:51:37.513336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cbbdbdc3-6735-4415-9dc8-5bc3a8e327c1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 204 len: 0 microversion: 2.20 time: 0.109937 Jan 21 13:51:37.513915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 364/722] 10.222.0.84 () {60 vars in 1279 bytes} [Fri Jan 21 13:51:37 2022] DELETE /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 21 13:51:37.522499 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:37.523111 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:37.529178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.529633 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:37.530407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.530943 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:37.660735 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:37.668412 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:37.669977 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:37.671934 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8af48c46-5a8f-4dbd-92f4-75e99e563aad tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.152424 Jan 21 13:51:37.672503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 359/723] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:37 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:37.943108 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:37.943808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:37.949479 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.949937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:37.950700 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:37.951138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:38.088513 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:38.096157 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-61b37efb-d9b6-4791-8188-1114f8a4ab1d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1318 microversion: 2.1 time: 0.157453 Jan 21 13:51:38.096746 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 365/724] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:37 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:38.691694 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:38.692293 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:38.698888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:38.699333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:38.700097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:38.700532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:38.834081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:38.841818 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:38.843466 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:38.844678 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-56c0145d-5bf5-4c52-aff9-0f01f12f0f65 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.156780 Jan 21 13:51:38.845240 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 360/725] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:38 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:38.967264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-0c0e5573-11a7-4821-bb2a-ff63248224c2 req-5e326668-3241-4be6-93d3-21121ed91c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4640e25e-e213-4542-9654-2e83e6695ae3", "name": "network-vif-plugged", "status": "completed", "tag": "eced43b6-af89-450c-850c-098b515fc717"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:38.969084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:38.969084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:51:38.976678 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-0c0e5573-11a7-4821-bb2a-ff63248224c2 req-5e326668-3241-4be6-93d3-21121ed91c85 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:38.977124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-0c0e5573-11a7-4821-bb2a-ff63248224c2 req-5e326668-3241-4be6-93d3-21121ed91c85 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:38.988485 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-0c0e5573-11a7-4821-bb2a-ff63248224c2 req-5e326668-3241-4be6-93d3-21121ed91c85 service nova] Creating event network-vif-plugged:eced43b6-af89-450c-850c-098b515fc717 for instance 4640e25e-e213-4542-9654-2e83e6695ae3 on hv-cinder-82016 Jan 21 13:51:38.993104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-0c0e5573-11a7-4821-bb2a-ff63248224c2 req-5e326668-3241-4be6-93d3-21121ed91c85 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029351 Jan 21 13:51:38.993681 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 366/726] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:39.113446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:39.114052 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:39.119724 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:39.120178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:39.120969 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:39.121398 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:39.270121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:39.279564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-422ccce1-ecbb-4b0f-87d8-853b835c0073 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1318 microversion: 2.1 time: 0.169932 Jan 21 13:51:39.280162 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 361/727] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:39 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:39.867015 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:39.867828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:39.874123 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:39.875344 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:39.876399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:39.877222 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:40.128260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:40.136639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:40.138391 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:40.139549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e8add4f8-3f5d-4056-b7f7-efcae2d3edbe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 200 len: 1724 microversion: 2.20 time: 0.276864 Jan 21 13:51:40.140521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 367/728] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:39 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:40.297020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:40.297558 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:40.303944 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:40.304665 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:40.305492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:40.306087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:40.509783 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:40.525058 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-047554d2-8c49-42e9-b45b-e29cca44163a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1318 microversion: 2.1 time: 0.232491 Jan 21 13:51:40.527152 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 362/729] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:40 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:40.575732 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-984f1f8b-4692-45ba-9a0c-79abd1102d2d req-ae52c792-bb97-47ec-939e-a607d3fbf867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade", "name": "network-vif-deleted", "tag": "13e896be-af8b-4c5b-b2fe-cd245c3385d1"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:40.578980 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:40.578980 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:51:40.590062 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-984f1f8b-4692-45ba-9a0c-79abd1102d2d req-ae52c792-bb97-47ec-939e-a607d3fbf867 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:40.590896 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-984f1f8b-4692-45ba-9a0c-79abd1102d2d req-ae52c792-bb97-47ec-939e-a607d3fbf867 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:40.603562 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-984f1f8b-4692-45ba-9a0c-79abd1102d2d req-ae52c792-bb97-47ec-939e-a607d3fbf867 service nova] Creating event network-vif-deleted:13e896be-af8b-4c5b-b2fe-cd245c3385d1 for instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade on hv-cinder-82016 Jan 21 13:51:40.609513 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-984f1f8b-4692-45ba-9a0c-79abd1102d2d req-ae52c792-bb97-47ec-939e-a607d3fbf867 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038521 Jan 21 13:51:40.610585 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 368/730] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:41.159919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:41.160529 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:41.180801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:41.181506 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:41.182451 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:41.182986 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:41.199498 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] HTTP exception thrown: Instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade could not be found. Jan 21 13:51:41.200097 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Returning 404 to user: Instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:51:41.200952 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-122ea6e9-a678-4d07-b4fb-bb1deea4f2fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 404 len: 111 microversion: 2.20 time: 0.046721 Jan 21 13:51:41.208696 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 363/731] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:41 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:51:41.211050 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f69ad45c-5767-4f51-940a-e473a443e6af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '.version_select at 0x7f51b6d610d0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:41.217440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f69ad45c-5767-4f51-940a-e473a443e6af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [3c33650f-7c18-4d96-8fea-cc3ec5a8ddad] AMQP server on 10.222.0.84:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 21 13:51:41.379139 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-792320631"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:41.379671 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:41.385822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:41.386271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:41.387039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:41.387468 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:41.541480 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.network.security_group_api [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Removing security group 87f9b4f1-f89d-4d54-a837-b3428966565d from port 2496e76e-909a-4437-9b2f-e13165d82630 Jan 21 13:51:41.979416 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6ade8793-fcde-45fc-92b5-a0dc2f24eb93 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.604626 Jan 21 13:51:41.980016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 364/732] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:51:41 2022] POST /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:51:41.986213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:41.987116 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:42.000495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:42.003772 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:42.004641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:42.005086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:42.227524 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [None req-f69ad45c-5767-4f51-940a-e473a443e6af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [3c33650f-7c18-4d96-8fea-cc3ec5a8ddad] Reconnected to AMQP server on 10.222.0.84:5672 via [amqp] client with port 39380. Jan 21 13:51:42.259372 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:42.267821 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e193b153-ff7d-499b-b0bb-437a5f5616ba tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1508 microversion: 2.1 time: 0.286072 Jan 21 13:51:42.271280 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 365/733] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:41 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:42.272678 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f69ad45c-5767-4f51-940a-e473a443e6af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054856804" status: 204 len: 0 microversion: 2.20 time: 1.065531 Jan 21 13:51:42.273437 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 369/734] 10.222.0.84 () {60 vars in 1261 bytes} [Fri Jan 21 13:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054856804 => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 21 13:51:42.281269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-6bddab60-b2a9-4431-b6b4-3c40235377c0 req-2b275934-2ab7-454a-a1a7-55634b7c6045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db945-4044-472e-89aa-39c0d1c95ea1", "tag": "2496e76e-909a-4437-9b2f-e13165d82630"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:42.290051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:42.290051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:51:42.330773 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6bddab60-b2a9-4431-b6b4-3c40235377c0 req-2b275934-2ab7-454a-a1a7-55634b7c6045 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:42.331304 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6bddab60-b2a9-4431-b6b4-3c40235377c0 req-2b275934-2ab7-454a-a1a7-55634b7c6045 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:42.358089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-6bddab60-b2a9-4431-b6b4-3c40235377c0 req-2b275934-2ab7-454a-a1a7-55634b7c6045 service nova] Creating event network-changed:2496e76e-909a-4437-9b2f-e13165d82630 for instance 701db945-4044-472e-89aa-39c0d1c95ea1 on hv-cinder-82016 Jan 21 13:51:42.370629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-6bddab60-b2a9-4431-b6b4-3c40235377c0 req-2b275934-2ab7-454a-a1a7-55634b7c6045 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093775 Jan 21 13:51:42.371177 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 370/735] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:43.443022 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c5891eb4-d0b1-4bc1-8b41-5e816b0d986c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'create', calling method: .version_select at 0x7f51b6c31550>, body: {"keypair": {"name": "tempest-keypair-742699872"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:43.465897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-c5891eb4-d0b1-4bc1-8b41-5e816b0d986c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:51:43.471370 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-c5891eb4-d0b1-4bc1-8b41-5e816b0d986c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for user 658d59ce11804cd6a1c498bdffffbe18 and project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:51:43.669544 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-c5891eb4-d0b1-4bc1-8b41-5e816b0d986c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:51:43.676012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-c5891eb4-d0b1-4bc1-8b41-5e816b0d986c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for user 658d59ce11804cd6a1c498bdffffbe18 and project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:51:43.691497 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c5891eb4-d0b1-4bc1-8b41-5e816b0d986c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.252188 Jan 21 13:51:43.692954 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 366/736] 10.222.0.84 () {62 vars in 1198 bytes} [Fri Jan 21 13:51:43 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 21 13:51:44.248467 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:44.249340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:44.266478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:44.267176 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:44.268018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:44.268456 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:44.279483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-b68aa72f-fae7-4a3a-b40a-cf04a1149c45 req-290993a8-6092-48e5-8d7a-af1260af4b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db945-4044-472e-89aa-39c0d1c95ea1", "tag": "2496e76e-909a-4437-9b2f-e13165d82630"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:44.282230 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:44.282230 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:51:44.294600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b68aa72f-fae7-4a3a-b40a-cf04a1149c45 req-290993a8-6092-48e5-8d7a-af1260af4b43 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:44.295001 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b68aa72f-fae7-4a3a-b40a-cf04a1149c45 req-290993a8-6092-48e5-8d7a-af1260af4b43 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:44.326794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-b68aa72f-fae7-4a3a-b40a-cf04a1149c45 req-290993a8-6092-48e5-8d7a-af1260af4b43 service nova] Creating event network-changed:2496e76e-909a-4437-9b2f-e13165d82630 for instance 701db945-4044-472e-89aa-39c0d1c95ea1 on hv-cinder-82016 Jan 21 13:51:44.341256 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-b68aa72f-fae7-4a3a-b40a-cf04a1149c45 req-290993a8-6092-48e5-8d7a-af1260af4b43 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072886 Jan 21 13:51:44.345035 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 367/737] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:51:44.448118 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lazy-loading 'services' on Instance uuid 701db945-4044-472e-89aa-39c0d1c95ea1 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:51:44.556884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1632c88b-3cb8-4a01-9e68-dc06d12a13fb tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "DELETE /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments/b1a45e5a-471d-43e2-857d-1ea312728fb9" status: 202 len: 0 microversion: 2.1 time: 0.312465 Jan 21 13:51:44.567818 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 371/738] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:51:44 2022] DELETE /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments/b1a45e5a-471d-43e2-857d-1ea312728fb9 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:51:44.577403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-06e95632-4aff-4c1a-8900-4918591a98e0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:44.579822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-06e95632-4aff-4c1a-8900-4918591a98e0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:44.594941 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-06e95632-4aff-4c1a-8900-4918591a98e0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:44.596091 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-06e95632-4aff-4c1a-8900-4918591a98e0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:44.597859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-06e95632-4aff-4c1a-8900-4918591a98e0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:44.598481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-06e95632-4aff-4c1a-8900-4918591a98e0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:44.642710 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-06e95632-4aff-4c1a-8900-4918591a98e0 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068067 Jan 21 13:51:44.644257 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 368/739] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:51:44 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:45.656808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-825c4420-6eae-477c-b135-b5ced10d9b3f tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:45.657822 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-825c4420-6eae-477c-b135-b5ced10d9b3f tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:45.664322 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-825c4420-6eae-477c-b135-b5ced10d9b3f tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:45.665051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-825c4420-6eae-477c-b135-b5ced10d9b3f tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:45.666754 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-825c4420-6eae-477c-b135-b5ced10d9b3f tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:45.667618 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-825c4420-6eae-477c-b135-b5ced10d9b3f tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:45.697872 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-825c4420-6eae-477c-b135-b5ced10d9b3f tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045702 Jan 21 13:51:45.698477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 372/740] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:51:45 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:51:45.708470 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:45.709209 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:45.715901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:45.716285 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:45.717087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:45.717685 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:45.797098 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] HTTP exception thrown: Instance 701db945-4044-472e-89aa-39c0d1c95ea1 is not attached to volume b1a45e5a-471d-43e2-857d-1ea312728fb9 Jan 21 13:51:45.797910 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Returning 404 to user: Instance 701db945-4044-472e-89aa-39c0d1c95ea1 is not attached to volume b1a45e5a-471d-43e2-857d-1ea312728fb9 {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:51:45.798828 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8110120a-041e-498d-80fa-a19083a94576 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "DELETE /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments/b1a45e5a-471d-43e2-857d-1ea312728fb9" status: 404 len: 154 microversion: 2.1 time: 0.094255 Jan 21 13:51:45.799583 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 369/741] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:51:45 2022] DELETE /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1/os-volume_attachments/b1a45e5a-471d-43e2-857d-1ea312728fb9 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:51:45.841113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-182086376", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ba9eaea-c320-46c7-b6bb-d0baef77b7da"}], "security_groups": [{"name": "tempest-securitygroup--908646107"}], "key_name": "tempest-keypair-742699872", "user_data": "}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:45.959094 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] validate_networks() for [('5ba9eaea-c320-46c7-b6bb-d0baef77b7da', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:51:46.347663 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:51:46.348125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:51:46.348603 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:51:46.349045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:51:46.349459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:51:46.358065 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:46.359061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:46.359975 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:46.360414 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:46.377313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:51:46.382070 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Getting quotas for user 658d59ce11804cd6a1c498bdffffbe18 and project e4e7437157cf4651b4c5152ebeee82e5. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:51:46.395221 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:51:46.397590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:51:46.444193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e729677d-b7ee-457e-b8cc-18dc56fedaf2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.606652 Jan 21 13:51:46.445477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 373/742] 10.222.0.84 () {62 vars in 1187 bytes} [Fri Jan 21 13:51:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 21 13:51:46.456628 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7351d628-c992-4152-afe4-b9288ceff6e3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:46.457261 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7351d628-c992-4152-afe4-b9288ceff6e3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:46.516957 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7351d628-c992-4152-afe4-b9288ceff6e3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:46.524923 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7351d628-c992-4152-afe4-b9288ceff6e3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:46.526483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7351d628-c992-4152-afe4-b9288ceff6e3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:46.527681 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7351d628-c992-4152-afe4-b9288ceff6e3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1280 microversion: 2.20 time: 0.076312 Jan 21 13:51:46.533329 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 370/743] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:46 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:46.959785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:46.960346 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:46.966919 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:46.967450 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:46.968343 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:46.968891 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:46.994379 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:51:47.085241 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-01d1b660-7c71-4d0c-a876-3e60f9335bb6 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "DELETE /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 204 len: 0 microversion: 2.1 time: 0.128803 Jan 21 13:51:47.086053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 374/744] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:51:46 2022] DELETE /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:51:47.094812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:47.095595 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:47.102072 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:47.102572 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:47.103604 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:47.104289 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:47.251129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:47.262024 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5b0c62b7-c9f0-4b1e-922c-5b32029562a4 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1551 microversion: 2.1 time: 0.171520 Jan 21 13:51:47.262587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 371/745] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:47 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:47.547079 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:47.548026 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:47.555125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:47.555837 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:47.556896 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:47.557641 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:47.637717 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:47.648274 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:47.650160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:47.652282 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ac3a10fd-0440-4c7c-9028-ada156fb13f0 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1350 microversion: 2.20 time: 0.108877 Jan 21 13:51:47.653540 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 375/746] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:47 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:48.284311 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:48.286030 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:48.302642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:48.303427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:48.305025 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:48.305701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:48.539648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:48.548001 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9e9d2e4f-f95c-4509-b075-46b16e0fb991 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1551 microversion: 2.1 time: 0.271384 Jan 21 13:51:48.549235 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 372/747] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:48 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1551 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:48.672453 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:48.673260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:48.680333 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:48.681040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:48.682217 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:48.682716 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:48.910921 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:48.924005 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:48.926258 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:48.927832 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e66048ac-0a19-4e06-9384-5f2180b91a18 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1405 microversion: 2.20 time: 0.260370 Jan 21 13:51:48.938101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 376/748] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:48 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:49.067338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-d3c0a6d2-f7b0-4014-822f-7b789ef621f0 req-c31cebe4-2fda-48ae-84ab-8c006946a5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f409b3-10f8-4920-b146-2587110be8f6", "tag": "a19095e3-cf06-48dc-9a39-1af3f2004ebb"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:49.069596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:49.069596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:51:49.078888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-d3c0a6d2-f7b0-4014-822f-7b789ef621f0 req-c31cebe4-2fda-48ae-84ab-8c006946a5b1 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:49.081940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-d3c0a6d2-f7b0-4014-822f-7b789ef621f0 req-c31cebe4-2fda-48ae-84ab-8c006946a5b1 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:49.101748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-d3c0a6d2-f7b0-4014-822f-7b789ef621f0 req-c31cebe4-2fda-48ae-84ab-8c006946a5b1 service nova] Creating event network-changed:a19095e3-cf06-48dc-9a39-1af3f2004ebb for instance 09f409b3-10f8-4920-b146-2587110be8f6 on hv-cinder-82016 Jan 21 13:51:49.113666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-d3c0a6d2-f7b0-4014-822f-7b789ef621f0 req-c31cebe4-2fda-48ae-84ab-8c006946a5b1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054184 Jan 21 13:51:49.115034 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 373/749] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:49.569497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:49.571122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:49.581798 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:49.582942 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:49.583955 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:49.584558 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:49.925696 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e653df84bc4f83beccfe6033469da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3afc808f84460e9dce024a40c56a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:49.933447 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6b4d77ee-2081-4aaa-9642-7fba10001291 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 200 len: 1551 microversion: 2.1 time: 0.370075 Jan 21 13:51:49.934084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 377/750] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:49 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 1551 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:49.950387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:49.951644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:49.966889 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:49.966889 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:49.966889 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:49.966889 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:50.104343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:50.114004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:50.115487 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:50.116792 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2189a92e-6192-4af1-a476-07dc16f4a698 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1405 microversion: 2.20 time: 0.171423 Jan 21 13:51:50.117360 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 374/751] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:49 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:50.951399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:50.952117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] [instance: 701db945-4044-472e-89aa-39c0d1c95ea1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:50.958782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:50.959378 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:50.960121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:50.960785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:50.975157 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] HTTP exception thrown: Instance 701db945-4044-472e-89aa-39c0d1c95ea1 could not be found. Jan 21 13:51:50.975759 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Returning 404 to user: Instance 701db945-4044-472e-89aa-39c0d1c95ea1 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:51:50.976593 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-683410fa-cdef-41a5-a961-0d4763acb143 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1" status: 404 len: 111 microversion: 2.1 time: 0.028918 Jan 21 13:51:50.977165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 378/752] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:51:50 2022] GET /compute/v2.1/servers/701db945-4044-472e-89aa-39c0d1c95ea1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:51:50.985897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-70275a0f-65cd-475e-977d-f95cf7daf6e7 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] Calling method '.version_select at 0x7f51b6c324c0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:51.004684 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-70275a0f-65cd-475e-977d-f95cf7daf6e7 tempest-TestMinimumBasicScenario-44873278 tempest-TestMinimumBasicScenario-44873278-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-42876764" status: 202 len: 0 microversion: 2.1 time: 0.023035 Jan 21 13:51:51.005249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 375/753] 10.222.0.84 () {58 vars in 1265 bytes} [Fri Jan 21 13:51:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-42876764 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:51:51.138193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:51.138911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:51.141755 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-ce498ea8-2b5b-47fd-828b-865c6d305d8a req-bce642a7-3518-4f75-9d3f-f34334505622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701db945-4044-472e-89aa-39c0d1c95ea1", "name": "network-vif-deleted", "tag": "2496e76e-909a-4437-9b2f-e13165d82630"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:51.143592 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:51.143592 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:51:51.145607 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:51.147455 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:51.148262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:51.148738 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:51.151488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ce498ea8-2b5b-47fd-828b-865c6d305d8a req-bce642a7-3518-4f75-9d3f-f34334505622 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:51.151931 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ce498ea8-2b5b-47fd-828b-865c6d305d8a req-bce642a7-3518-4f75-9d3f-f34334505622 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:51.163224 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-ce498ea8-2b5b-47fd-828b-865c6d305d8a req-bce642a7-3518-4f75-9d3f-f34334505622 service nova] Creating event network-vif-deleted:2496e76e-909a-4437-9b2f-e13165d82630 for instance 701db945-4044-472e-89aa-39c0d1c95ea1 on hv-cinder-82016 Jan 21 13:51:51.168044 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-ce498ea8-2b5b-47fd-828b-865c6d305d8a req-bce642a7-3518-4f75-9d3f-f34334505622 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030351 Jan 21 13:51:51.168650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 376/754] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:51.287018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:51.294794 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:51.297216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:51.298211 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-72542520-7348-4012-aede-06e3514d9b88 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1405 microversion: 2.20 time: 0.165811 Jan 21 13:51:51.298758 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 379/755] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:51 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:52.316686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:52.317381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:52.323233 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:52.323684 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:52.324463 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:52.324926 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:52.520061 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:52.527726 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:52.529516 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:52.530612 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d0ba081d-c0ca-4f7b-a570-82e310ceffc5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1405 microversion: 2.20 time: 0.219082 Jan 21 13:51:52.531172 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 377/756] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:52 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:53.551328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:53.551932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:53.568439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:53.569125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:53.570332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:53.570955 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:53.747430 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:53.756634 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:53.758565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:53.760003 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-362b0df5-2af1-428e-9526-aea0d9d85ea6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1405 microversion: 2.20 time: 0.212456 Jan 21 13:51:53.761206 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 380/757] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:53 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:54.779657 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:54.783999 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:54.793033 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:54.793580 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:54.794512 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:54.796728 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:54.963181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:54.972811 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:54.974607 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:54.975820 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9a75eb1d-b9d9-4a26-819b-0c67813a3e43 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1405 microversion: 2.20 time: 0.200531 Jan 21 13:51:54.978957 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 378/758] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:54 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:55.148227 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-89b2bc5c-f923-4246-9734-d66902681646 req-ca1f474f-78c5-4dde-91e2-d107755d4c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f409b3-10f8-4920-b146-2587110be8f6", "name": "network-vif-plugged", "status": "completed", "tag": "a19095e3-cf06-48dc-9a39-1af3f2004ebb"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:55.150335 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:55.150335 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:51:55.171599 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-89b2bc5c-f923-4246-9734-d66902681646 req-ca1f474f-78c5-4dde-91e2-d107755d4c3a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:55.172054 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-89b2bc5c-f923-4246-9734-d66902681646 req-ca1f474f-78c5-4dde-91e2-d107755d4c3a service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:55.212600 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-89b2bc5c-f923-4246-9734-d66902681646 req-ca1f474f-78c5-4dde-91e2-d107755d4c3a service nova] Creating event network-vif-plugged:a19095e3-cf06-48dc-9a39-1af3f2004ebb for instance 09f409b3-10f8-4920-b146-2587110be8f6 on hv-cinder-82016 Jan 21 13:51:55.219707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-89b2bc5c-f923-4246-9734-d66902681646 req-ca1f474f-78c5-4dde-91e2-d107755d4c3a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075252 Jan 21 13:51:55.221080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 381/759] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:51:55.993587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:55.994218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:56.001779 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:56.002237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:56.003162 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:56.003613 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:56.222784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:56.231864 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:56.234265 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:56.235425 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ed9a0b43-97e6-4347-ba69-00ee75a87ca7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1405 microversion: 2.20 time: 0.245459 Jan 21 13:51:56.236247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 379/760] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:55 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:51:57.257581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:57.257581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:57.273576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:57.274114 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:57.276483 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:57.278715 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:57.540845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:57.549911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:57.551920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:51:57.553196 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-90be54b9-7f8c-421c-9958-d08e80405aa9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1597 microversion: 2.20 time: 0.302923 Jan 21 13:51:57.554287 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 382/761] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:51:57 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1597 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:51:57.578134 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e572a804-6a91-4f03-9483-512e8160b657 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:51:57.579208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e572a804-6a91-4f03-9483-512e8160b657 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:57.586016 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e572a804-6a91-4f03-9483-512e8160b657 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:57.586664 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e572a804-6a91-4f03-9483-512e8160b657 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:57.587619 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e572a804-6a91-4f03-9483-512e8160b657 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:57.588214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e572a804-6a91-4f03-9483-512e8160b657 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:57.686055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e572a804-6a91-4f03-9483-512e8160b657 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117408 Jan 21 13:51:57.687221 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 380/762] 10.222.0.84 () {60 vars in 1315 bytes} [Fri Jan 21 13:51:57 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:51:58.976805 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f6b873aa-6e5d-411e-9b11-4cffca376e78 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:58.977724 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f6b873aa-6e5d-411e-9b11-4cffca376e78 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:51:58.988698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-ee82ca96-f2cd-4ec6-91d3-a5c69241664b req-ea041b92-60ac-4370-b2de-806e0dd364bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f409b3-10f8-4920-b146-2587110be8f6", "tag": "a19095e3-cf06-48dc-9a39-1af3f2004ebb"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:58.990402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:51:58.990402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:51:58.995578 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f6b873aa-6e5d-411e-9b11-4cffca376e78 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:58.996028 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f6b873aa-6e5d-411e-9b11-4cffca376e78 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:58.996844 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f6b873aa-6e5d-411e-9b11-4cffca376e78 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:58.997679 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ee82ca96-f2cd-4ec6-91d3-a5c69241664b req-ea041b92-60ac-4370-b2de-806e0dd364bb service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:51:58.998010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f6b873aa-6e5d-411e-9b11-4cffca376e78 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:58.998141 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ee82ca96-f2cd-4ec6-91d3-a5c69241664b req-ea041b92-60ac-4370-b2de-806e0dd364bb service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:51:59.011368 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-ee82ca96-f2cd-4ec6-91d3-a5c69241664b req-ea041b92-60ac-4370-b2de-806e0dd364bb service nova] Creating event network-changed:a19095e3-cf06-48dc-9a39-1af3f2004ebb for instance 09f409b3-10f8-4920-b146-2587110be8f6 on hv-cinder-82016 Jan 21 13:51:59.019203 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-ee82ca96-f2cd-4ec6-91d3-a5c69241664b req-ea041b92-60ac-4370-b2de-806e0dd364bb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036008 Jan 21 13:51:59.020488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 381/763] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:51:59.099313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f6b873aa-6e5d-411e-9b11-4cffca376e78 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 14 microversion: 2.20 time: 0.125537 Jan 21 13:51:59.100351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 383/764] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:51:58 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:51:59.996121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bc0c4f00-c0a7-47f5-8aac-4c0e7a2b20bb tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0462858f-30ff-46d9-a545-754441c44c79", "device": "/dev/sdb"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:51:59.998497 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bc0c4f00-c0a7-47f5-8aac-4c0e7a2b20bb tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:00.011169 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc0c4f00-c0a7-47f5-8aac-4c0e7a2b20bb tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:00.013710 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc0c4f00-c0a7-47f5-8aac-4c0e7a2b20bb tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:00.015885 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc0c4f00-c0a7-47f5-8aac-4c0e7a2b20bb tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:00.016875 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc0c4f00-c0a7-47f5-8aac-4c0e7a2b20bb tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:00.113007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-35a41eb7-203e-40d6-b71b-a674af6911a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:00.114612 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-35a41eb7-203e-40d6-b71b-a674af6911a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:00.135473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a41eb7-203e-40d6-b71b-a674af6911a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:00.136783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a41eb7-203e-40d6-b71b-a674af6911a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:00.138187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a41eb7-203e-40d6-b71b-a674af6911a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:00.138836 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a41eb7-203e-40d6-b71b-a674af6911a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:00.256674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-35a41eb7-203e-40d6-b71b-a674af6911a1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 14 microversion: 2.20 time: 0.149565 Jan 21 13:52:00.257335 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 384/765] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:00 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:00.416142 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bc0c4f00-c0a7-47f5-8aac-4c0e7a2b20bb tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "POST /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423992 Jan 21 13:52:00.417414 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 382/766] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:51:59 2022] POST /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:01.268311 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-875ad8a4-1797-4841-b06c-33e815c70e71 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:01.269411 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-875ad8a4-1797-4841-b06c-33e815c70e71 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:01.276159 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-875ad8a4-1797-4841-b06c-33e815c70e71 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:01.276639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-875ad8a4-1797-4841-b06c-33e815c70e71 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:01.277404 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-875ad8a4-1797-4841-b06c-33e815c70e71 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:01.278091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-875ad8a4-1797-4841-b06c-33e815c70e71 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:01.347373 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-875ad8a4-1797-4841-b06c-33e815c70e71 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 14 microversion: 2.20 time: 0.083374 Jan 21 13:52:01.350588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 385/767] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:01 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:02.359545 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-913bb75a-4250-423e-93eb-dfaed6eea89e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:02.361184 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-913bb75a-4250-423e-93eb-dfaed6eea89e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:02.367551 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-913bb75a-4250-423e-93eb-dfaed6eea89e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:02.368007 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-913bb75a-4250-423e-93eb-dfaed6eea89e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:02.369137 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-913bb75a-4250-423e-93eb-dfaed6eea89e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:02.370865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-913bb75a-4250-423e-93eb-dfaed6eea89e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:04.479471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-913bb75a-4250-423e-93eb-dfaed6eea89e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 14 microversion: 2.20 time: 2.124596 Jan 21 13:52:04.480139 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 383/768] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:02 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 14 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:05.494011 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-946edbcd-b2d7-4995-8bb8-a035b9a5db7c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:05.496474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-946edbcd-b2d7-4995-8bb8-a035b9a5db7c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:05.505418 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-946edbcd-b2d7-4995-8bb8-a035b9a5db7c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:05.506242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-946edbcd-b2d7-4995-8bb8-a035b9a5db7c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:05.507238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-946edbcd-b2d7-4995-8bb8-a035b9a5db7c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:05.507674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-946edbcd-b2d7-4995-8bb8-a035b9a5db7c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:05.570142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-946edbcd-b2d7-4995-8bb8-a035b9a5db7c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 14 microversion: 2.20 time: 0.082788 Jan 21 13:52:05.573589 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 386/769] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:05 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:06.589256 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5047b8be-d3b0-4371-b0f9-4a90d6314e7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:06.590328 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5047b8be-d3b0-4371-b0f9-4a90d6314e7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:06.599355 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5047b8be-d3b0-4371-b0f9-4a90d6314e7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:06.600113 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5047b8be-d3b0-4371-b0f9-4a90d6314e7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:06.601746 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5047b8be-d3b0-4371-b0f9-4a90d6314e7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:06.602401 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5047b8be-d3b0-4371-b0f9-4a90d6314e7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:06.674526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5047b8be-d3b0-4371-b0f9-4a90d6314e7f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 14 microversion: 2.20 time: 0.096650 Jan 21 13:52:06.678750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 384/770] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:06 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:07.687931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a9ee100b-cc8e-41d7-b425-c8cd6d6aa294 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:07.688942 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a9ee100b-cc8e-41d7-b425-c8cd6d6aa294 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:07.700956 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9ee100b-cc8e-41d7-b425-c8cd6d6aa294 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:07.701568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9ee100b-cc8e-41d7-b425-c8cd6d6aa294 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:07.702396 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9ee100b-cc8e-41d7-b425-c8cd6d6aa294 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:07.702832 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9ee100b-cc8e-41d7-b425-c8cd6d6aa294 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:07.793584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a9ee100b-cc8e-41d7-b425-c8cd6d6aa294 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 14 microversion: 2.20 time: 0.108252 Jan 21 13:52:07.795473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 387/771] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:07 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:08.806369 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-82312497-88b1-4328-ad9d-c7110caca5a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:08.808089 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-82312497-88b1-4328-ad9d-c7110caca5a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:08.821190 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-82312497-88b1-4328-ad9d-c7110caca5a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:08.821642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-82312497-88b1-4328-ad9d-c7110caca5a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:08.822445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-82312497-88b1-4328-ad9d-c7110caca5a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:08.822893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-82312497-88b1-4328-ad9d-c7110caca5a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:11.244913 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-82312497-88b1-4328-ad9d-c7110caca5a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 13967 microversion: 2.20 time: 2.443622 Jan 21 13:52:11.245594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 385/772] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:08 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 13967 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:11.953163 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e261a7e4-e878-4fd0-8c38-5abb62378e45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Action: 'create', calling method: .version_select at 0x7f51b6cc0670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-264786425"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:11.966649 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e261a7e4-e878-4fd0-8c38-5abb62378e45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:52:11.971053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e261a7e4-e878-4fd0-8c38-5abb62378e45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for user 0ae8a49f6ca54b8095d6ac95bd03bee0 and project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:52:12.145348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e261a7e4-e878-4fd0-8c38-5abb62378e45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:52:12.149142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e261a7e4-e878-4fd0-8c38-5abb62378e45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for user 0ae8a49f6ca54b8095d6ac95bd03bee0 and project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:52:12.162904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e261a7e4-e878-4fd0-8c38-5abb62378e45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.407384 Jan 21 13:52:12.163515 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 388/773] 10.222.0.84 () {60 vars in 1157 bytes} [Fri Jan 21 13:52:11 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:12.259617 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ea322152-9e68-4dfd-9cb9-35dba4e73899 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:12.260907 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ea322152-9e68-4dfd-9cb9-35dba4e73899 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:12.269456 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ea322152-9e68-4dfd-9cb9-35dba4e73899 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:12.270256 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ea322152-9e68-4dfd-9cb9-35dba4e73899 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:12.271147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ea322152-9e68-4dfd-9cb9-35dba4e73899 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:12.271694 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ea322152-9e68-4dfd-9cb9-35dba4e73899 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:12.349716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ea322152-9e68-4dfd-9cb9-35dba4e73899 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 18305 microversion: 2.20 time: 0.095088 Jan 21 13:52:12.349865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 386/774] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:12 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 18305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:13.361749 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f053db3e-c61c-45d1-8f24-3afd3470e26a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:13.362781 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f053db3e-c61c-45d1-8f24-3afd3470e26a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:13.369624 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f053db3e-c61c-45d1-8f24-3afd3470e26a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:13.370066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f053db3e-c61c-45d1-8f24-3afd3470e26a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:13.370860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f053db3e-c61c-45d1-8f24-3afd3470e26a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:13.371288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f053db3e-c61c-45d1-8f24-3afd3470e26a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:15.518640 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f053db3e-c61c-45d1-8f24-3afd3470e26a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 22981 microversion: 2.20 time: 2.161491 Jan 21 13:52:15.522976 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 389/775] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:13 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 22981 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:16.531387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-23f70bc6-71f6-438f-8b59-7a6e39c40bab tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:16.532388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-23f70bc6-71f6-438f-8b59-7a6e39c40bab tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:16.539443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23f70bc6-71f6-438f-8b59-7a6e39c40bab tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:16.539907 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23f70bc6-71f6-438f-8b59-7a6e39c40bab tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:16.540731 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23f70bc6-71f6-438f-8b59-7a6e39c40bab tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:16.541186 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-23f70bc6-71f6-438f-8b59-7a6e39c40bab tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:16.621079 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-23f70bc6-71f6-438f-8b59-7a6e39c40bab tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 23886 microversion: 2.20 time: 0.094121 Jan 21 13:52:16.622543 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 387/776] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:16 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 23886 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:17.633804 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b529c7e9-cb34-44a1-a7b2-2569de2fcf72 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:17.634848 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b529c7e9-cb34-44a1-a7b2-2569de2fcf72 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:17.642981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b529c7e9-cb34-44a1-a7b2-2569de2fcf72 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:17.643437 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b529c7e9-cb34-44a1-a7b2-2569de2fcf72 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:17.644230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b529c7e9-cb34-44a1-a7b2-2569de2fcf72 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:17.644701 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b529c7e9-cb34-44a1-a7b2-2569de2fcf72 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:19.975576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b529c7e9-cb34-44a1-a7b2-2569de2fcf72 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 27159 microversion: 2.20 time: 2.345934 Jan 21 13:52:19.977050 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 390/777] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:17 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 27159 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:20.219344 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-27405deb-1662-4c64-9c82-c1190017cdc8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:20.220944 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-27405deb-1662-4c64-9c82-c1190017cdc8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:20.227983 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27405deb-1662-4c64-9c82-c1190017cdc8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.228437 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27405deb-1662-4c64-9c82-c1190017cdc8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:20.229267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27405deb-1662-4c64-9c82-c1190017cdc8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.229707 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27405deb-1662-4c64-9c82-c1190017cdc8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:20.261620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-27405deb-1662-4c64-9c82-c1190017cdc8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047290 Jan 21 13:52:20.262101 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 388/778] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:52:20 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:20.318619 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:20.319224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:20.328189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.328712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:20.329510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.329952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:20.356753 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:52:20.435269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d2ff5e6a-9789-4b05-85dd-d5d7bb83cde3 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 204 len: 0 microversion: 2.1 time: 0.120524 Jan 21 13:52:20.436565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 391/779] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:52:20 2022] DELETE /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:52:20.444528 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:20.445180 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:20.451420 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.451865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:20.452644 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.453078 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:20.696251 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:20.704370 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3d4b026d-376e-4d8d-969d-972120a2b581 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1672 microversion: 2.1 time: 0.263555 Jan 21 13:52:20.705041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 389/780] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:20 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1672 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:20.988277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5ef8c0be-66ea-4aac-980e-babd1c0c535a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:20.989314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5ef8c0be-66ea-4aac-980e-babd1c0c535a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:20.995703 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ef8c0be-66ea-4aac-980e-babd1c0c535a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.996159 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ef8c0be-66ea-4aac-980e-babd1c0c535a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:20.996989 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ef8c0be-66ea-4aac-980e-babd1c0c535a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:20.997459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ef8c0be-66ea-4aac-980e-babd1c0c535a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:21.085426 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5ef8c0be-66ea-4aac-980e-babd1c0c535a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 27475 microversion: 2.20 time: 0.100956 Jan 21 13:52:21.086479 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 392/781] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:20 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 27475 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:21.721606 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:21.722218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:21.729178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:21.729641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:21.730639 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:21.731087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:21.874990 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:21.882447 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4fa93eb8-f13d-4051-9b05-87d60156fa15 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1672 microversion: 2.1 time: 0.164621 Jan 21 13:52:21.883168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 390/782] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:21 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:22.098587 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-202763f7-9acb-49a9-879d-aaf05fd25f69 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:22.099586 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-202763f7-9acb-49a9-879d-aaf05fd25f69 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:22.108272 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-202763f7-9acb-49a9-879d-aaf05fd25f69 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:22.108807 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-202763f7-9acb-49a9-879d-aaf05fd25f69 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:22.109596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-202763f7-9acb-49a9-879d-aaf05fd25f69 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:22.110045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-202763f7-9acb-49a9-879d-aaf05fd25f69 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:22.189810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-202763f7-9acb-49a9-879d-aaf05fd25f69 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 27613 microversion: 2.20 time: 0.095052 Jan 21 13:52:22.190496 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 393/783] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:22 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 27613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:23.002650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:23.003357 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:23.009506 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:23.009964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:23.010752 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:23.011194 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:23.171794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:23.180326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e3ac174b-4bee-43ef-8a56-76dbfca99c4e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1672 microversion: 2.1 time: 0.284647 Jan 21 13:52:23.181228 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 391/784] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:22 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:23.205256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f64c7f75-a61f-4d3d-9ef4-cc604489d20a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:23.206248 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f64c7f75-a61f-4d3d-9ef4-cc604489d20a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:23.212903 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f64c7f75-a61f-4d3d-9ef4-cc604489d20a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:23.213346 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f64c7f75-a61f-4d3d-9ef4-cc604489d20a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:23.214131 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f64c7f75-a61f-4d3d-9ef4-cc604489d20a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:23.214558 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f64c7f75-a61f-4d3d-9ef4-cc604489d20a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:23.303312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f64c7f75-a61f-4d3d-9ef4-cc604489d20a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28019 microversion: 2.20 time: 0.103951 Jan 21 13:52:23.303965 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 394/785] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:23 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28019 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:24.063324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-3e660e26-33d7-4995-8fa6-dc59294fa1a9 req-143e0632-ff5f-47f9-bc96-9a5482c6a8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59552fe-d2ae-43ad-bf63-f4d6958c05fc", "name": "network-vif-deleted", "tag": "6727a4f0-5a23-4ef3-b87b-c106a6420440"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:24.065697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:24.065697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:52:24.076057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-3e660e26-33d7-4995-8fa6-dc59294fa1a9 req-143e0632-ff5f-47f9-bc96-9a5482c6a8ea service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.076987 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-3e660e26-33d7-4995-8fa6-dc59294fa1a9 req-143e0632-ff5f-47f9-bc96-9a5482c6a8ea service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.094038 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-3e660e26-33d7-4995-8fa6-dc59294fa1a9 req-143e0632-ff5f-47f9-bc96-9a5482c6a8ea service nova] Creating event network-vif-deleted:6727a4f0-5a23-4ef3-b87b-c106a6420440 for instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc on hv-cinder-82016 Jan 21 13:52:24.101166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-3e660e26-33d7-4995-8fa6-dc59294fa1a9 req-143e0632-ff5f-47f9-bc96-9a5482c6a8ea service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113127 Jan 21 13:52:24.101862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 392/786] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:24.199034 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:24.199729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:24.211927 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.212488 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.213171 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.213635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.250220 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.250662 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.251104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lazy-loading 'fault' on Instance uuid e59552fe-d2ae-43ad-bf63-f4d6958c05fc {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:52:24.319295 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6dff6fd5-846a-4bd7-9858-f9b3bb362830 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:24.320681 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6dff6fd5-846a-4bd7-9858-f9b3bb362830 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:24.327604 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dff6fd5-846a-4bd7-9858-f9b3bb362830 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.328374 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dff6fd5-846a-4bd7-9858-f9b3bb362830 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.329489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dff6fd5-846a-4bd7-9858-f9b3bb362830 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.330105 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dff6fd5-846a-4bd7-9858-f9b3bb362830 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.433969 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6dff6fd5-846a-4bd7-9858-f9b3bb362830 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28202 microversion: 2.20 time: 0.119828 Jan 21 13:52:24.434555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 393/787] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:24 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28202 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:24.442112 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:24.442886 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:24.450061 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.451322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.453048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:24.453666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:24.569612 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lazy-loading 'services' on Instance uuid 4640e25e-e213-4542-9654-2e83e6695ae3 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:52:24.598214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:24.617156 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f8d6dfaf-101e-4e25-8306-bd91f91ff9dd tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 200 len: 1327 microversion: 2.1 time: 0.421850 Jan 21 13:52:24.619124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 395/788] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:24 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 1327 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:24.687681 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-26313a91-18ce-4e2d-9148-455f58fd4ea5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3/os-volume_attachments/0462858f-30ff-46d9-a545-754441c44c79" status: 202 len: 0 microversion: 2.1 time: 0.250442 Jan 21 13:52:24.688277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 394/789] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:52:24 2022] DELETE /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3/os-volume_attachments/0462858f-30ff-46d9-a545-754441c44c79 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:25.556549 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-74f9c15d-7d5d-45dc-ba45-6c1773ed21c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:25.557500 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-74f9c15d-7d5d-45dc-ba45-6c1773ed21c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:25.566638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74f9c15d-7d5d-45dc-ba45-6c1773ed21c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.567081 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74f9c15d-7d5d-45dc-ba45-6c1773ed21c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:25.567886 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74f9c15d-7d5d-45dc-ba45-6c1773ed21c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.568406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74f9c15d-7d5d-45dc-ba45-6c1773ed21c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:25.632454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-74f9c15d-7d5d-45dc-ba45-6c1773ed21c5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28202 microversion: 2.20 time: 0.189453 Jan 21 13:52:25.633684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 396/790] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:25 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28202 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:25.637211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:25.637924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:25.644695 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.645162 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:25.645970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.646405 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:25.660376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] HTTP exception thrown: Instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc could not be found. Jan 21 13:52:25.660999 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Returning 404 to user: Instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:52:25.661821 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-211ab633-4dc1-474d-a4cd-0abaec1b0547 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 404 len: 111 microversion: 2.1 time: 0.029816 Jan 21 13:52:25.662353 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 395/791] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:25 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:52:25.672160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-72e9f56d-dba7-4a93-a153-687784e2b121 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '.version_select at 0x7f51b6ceaca0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:25.689870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-72e9f56d-dba7-4a93-a153-687784e2b121 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407374827" status: 202 len: 0 microversion: 2.1 time: 0.022690 Jan 21 13:52:25.690433 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 397/792] 10.222.0.84 () {58 vars in 1217 bytes} [Fri Jan 21 13:52:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407374827 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:25.809836 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:25.810353 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:25.816012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.816454 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:25.817255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.817685 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:25.849848 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:52:25.937712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d6f94e06-03d7-4d63-81a6-cb1a8322dc0f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 204 len: 0 microversion: 2.1 time: 0.131258 Jan 21 13:52:25.938471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 396/793] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:52:25 2022] DELETE /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:52:25.947168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:25.947913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:25.956238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.956973 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:25.957764 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:25.958232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:26.096291 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:26.103879 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c20a6343-2d00-47a8-9cf2-b88464ddcb7f tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1514 microversion: 2.1 time: 0.160663 Jan 21 13:52:26.114714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 398/794] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:25 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:26.362686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-57fbab65-ba8f-460d-a938-3e8afa0ed54b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'create', calling method: .version_select at 0x7f51b6bdbc10>, body: {"keypair": {"name": "tempest-keypair-138956406"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:26.376723 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-57fbab65-ba8f-460d-a938-3e8afa0ed54b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:52:26.380433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-57fbab65-ba8f-460d-a938-3e8afa0ed54b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for user a5f49de6688841e2b5aaa7f117278348 and project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:52:26.610824 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-57fbab65-ba8f-460d-a938-3e8afa0ed54b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:52:26.614388 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-57fbab65-ba8f-460d-a938-3e8afa0ed54b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for user a5f49de6688841e2b5aaa7f117278348 and project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'key_pairs'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:52:26.628598 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-57fbab65-ba8f-460d-a938-3e8afa0ed54b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.269968 Jan 21 13:52:26.629878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 397/795] 10.222.0.84 () {60 vars in 1157 bytes} [Fri Jan 21 13:52:26 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:26.643481 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b8c243ad-7be5-4b0e-82d1-a8283f55918f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:26.644591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b8c243ad-7be5-4b0e-82d1-a8283f55918f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:26.652984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8c243ad-7be5-4b0e-82d1-a8283f55918f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:26.654321 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8c243ad-7be5-4b0e-82d1-a8283f55918f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:26.654849 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8c243ad-7be5-4b0e-82d1-a8283f55918f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:26.655312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8c243ad-7be5-4b0e-82d1-a8283f55918f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:26.743581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b8c243ad-7be5-4b0e-82d1-a8283f55918f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28493 microversion: 2.20 time: 0.103265 Jan 21 13:52:26.749356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 399/796] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:26 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28493 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:27.122010 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:27.124712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:27.129781 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:27.130229 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:27.130999 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:27.131430 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:27.270053 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:27.277989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-de8e8331-f128-4836-9736-3608ee204389 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1514 microversion: 2.1 time: 0.159442 Jan 21 13:52:27.288215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 398/797] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:27 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:27.757021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-479935c9-6db2-4fbd-a810-91ccf4fa922f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:27.758017 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-479935c9-6db2-4fbd-a810-91ccf4fa922f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:27.765748 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-479935c9-6db2-4fbd-a810-91ccf4fa922f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:27.766212 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-479935c9-6db2-4fbd-a810-91ccf4fa922f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:27.767009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-479935c9-6db2-4fbd-a810-91ccf4fa922f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:27.767454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-479935c9-6db2-4fbd-a810-91ccf4fa922f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:27.848991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-479935c9-6db2-4fbd-a810-91ccf4fa922f tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28587 microversion: 2.20 time: 0.095659 Jan 21 13:52:27.850029 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 400/798] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:27 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28587 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:27.911589 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1882750926", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "257b1f17-c2c3-4ac6-a932-3ddca797ac52"}], "security_groups": [{"name": "tempest-securitygroup--158924431"}], "key_name": "tempest-keypair-138956406", "user_data": "}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:28.009528 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] validate_networks() for [('257b1f17-c2c3-4ac6-a932-3ddca797ac52', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:52:28.288288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-d0c96429-882d-444a-8ef6-888235322aa3 req-0e4aa4ca-251d-4488-9d07-f72892535eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4640e25e-e213-4542-9654-2e83e6695ae3", "name": "network-vif-deleted", "tag": "eced43b6-af89-450c-850c-098b515fc717"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:28.290142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:28.290142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:52:28.299442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d0c96429-882d-444a-8ef6-888235322aa3 req-0e4aa4ca-251d-4488-9d07-f72892535eb4 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:28.299893 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d0c96429-882d-444a-8ef6-888235322aa3 req-0e4aa4ca-251d-4488-9d07-f72892535eb4 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:28.314892 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-d0c96429-882d-444a-8ef6-888235322aa3 req-0e4aa4ca-251d-4488-9d07-f72892535eb4 service nova] Creating event network-vif-deleted:eced43b6-af89-450c-850c-098b515fc717 for instance 4640e25e-e213-4542-9654-2e83e6695ae3 on hv-cinder-82016 Jan 21 13:52:28.319582 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-d0c96429-882d-444a-8ef6-888235322aa3 req-0e4aa4ca-251d-4488-9d07-f72892535eb4 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035650 Jan 21 13:52:28.320392 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 401/799] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:28.325568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:28.326349 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:28.332649 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:28.333307 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:28.334263 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:28.334888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:28.401072 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:28.409333 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-10924bb3-f146-44eb-b5bf-7a67fcab2e63 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 200 len: 1303 microversion: 2.1 time: 0.087606 Jan 21 13:52:28.409906 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 402/800] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:28 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:28.448783 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:52:28.449300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:52:28.449681 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:52:28.450092 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:52:28.450558 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:52:28.459104 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:28.460141 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:28.461004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:28.461452 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:28.477554 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:52:28.481339 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Getting quotas for user a5f49de6688841e2b5aaa7f117278348 and project 21b908f3a07442bcbeabe49a50f7f48a. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:52:28.492539 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:52:28.494835 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:52:28.539812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1fd9adbd-8b96-4553-be38-9c0ce4c1384f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.632427 Jan 21 13:52:28.540470 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 399/801] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:52:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:52:28.550803 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f8516c4d-4b09-434b-98bc-26372cf0e05c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:28.551416 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f8516c4d-4b09-434b-98bc-26372cf0e05c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:28.603565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f8516c4d-4b09-434b-98bc-26372cf0e05c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:28.611101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f8516c4d-4b09-434b-98bc-26372cf0e05c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1237 microversion: 2.1 time: 0.063883 Jan 21 13:52:28.611668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 403/802] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:28 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:28.860313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e1ae4e87-888e-4dec-9a3c-89f5db954c8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:28.861510 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e1ae4e87-888e-4dec-9a3c-89f5db954c8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:28.869715 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1ae4e87-888e-4dec-9a3c-89f5db954c8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:28.870177 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1ae4e87-888e-4dec-9a3c-89f5db954c8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:28.871004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1ae4e87-888e-4dec-9a3c-89f5db954c8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:28.871716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1ae4e87-888e-4dec-9a3c-89f5db954c8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:28.953627 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e1ae4e87-888e-4dec-9a3c-89f5db954c8b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.096904 Jan 21 13:52:28.954317 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 400/803] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:28 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:29.425343 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:29.425959 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 4640e25e-e213-4542-9654-2e83e6695ae3] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:29.432875 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:29.433331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:29.434121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:29.435117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:29.448142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] HTTP exception thrown: Instance 4640e25e-e213-4542-9654-2e83e6695ae3 could not be found. Jan 21 13:52:29.448766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Returning 404 to user: Instance 4640e25e-e213-4542-9654-2e83e6695ae3 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:52:29.449658 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e0101c18-6def-48b0-8076-34da5e2ce040 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3" status: 404 len: 111 microversion: 2.1 time: 0.027971 Jan 21 13:52:29.450255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 404/804] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:29 2022] GET /compute/v2.1/servers/4640e25e-e213-4542-9654-2e83e6695ae3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:52:29.637919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:29.642724 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:29.652685 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:29.653758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:29.655118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:29.655626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:29.726014 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:29.734880 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d953a92b-ef9a-479d-bee7-5235b1b96596 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1307 microversion: 2.1 time: 0.110194 Jan 21 13:52:29.735601 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 401/805] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:29 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:29.965306 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-276d59b7-65c5-411c-9761-bbd9b68726ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:29.966429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-276d59b7-65c5-411c-9761-bbd9b68726ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:29.972638 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-276d59b7-65c5-411c-9761-bbd9b68726ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:29.973101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-276d59b7-65c5-411c-9761-bbd9b68726ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:29.973885 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-276d59b7-65c5-411c-9761-bbd9b68726ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:29.974332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-276d59b7-65c5-411c-9761-bbd9b68726ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:30.059574 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-276d59b7-65c5-411c-9761-bbd9b68726ae tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.097982 Jan 21 13:52:30.060992 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 405/806] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:29 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:30.752167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:30.752759 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:30.758949 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:30.759406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:30.760179 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:30.760627 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:30.889503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:30.896845 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7430c6bb-2570-48c2-857c-6c99215e032a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.148318 Jan 21 13:52:30.897411 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 402/807] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:30 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:31.071798 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-009dc2ff-7db8-449f-b017-216e5075007d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:31.072772 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-009dc2ff-7db8-449f-b017-216e5075007d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:31.080441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-009dc2ff-7db8-449f-b017-216e5075007d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:31.080914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-009dc2ff-7db8-449f-b017-216e5075007d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:31.081692 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-009dc2ff-7db8-449f-b017-216e5075007d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:31.082123 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-009dc2ff-7db8-449f-b017-216e5075007d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:31.914338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:31.915070 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:31.922086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:31.922539 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:31.923323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:31.923761 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:32.056931 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:32.066121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-08d2ab3b-3110-439e-bf4f-112af51ed384 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.155425 Jan 21 13:52:32.066690 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 403/808] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:31 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:32.433361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-d92cbf4a-b996-40fd-aa53-417cdc92bcbc req-30311a1f-7d43-4e64-985f-8d25e397ef82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406e22ef-2339-49fb-9f7f-3568a327b764", "tag": "3388ca83-ec51-4aee-aede-a4637d3d327d"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:32.436262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:32.436262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:52:32.444987 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-d92cbf4a-b996-40fd-aa53-417cdc92bcbc req-30311a1f-7d43-4e64-985f-8d25e397ef82 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:32.445709 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-d92cbf4a-b996-40fd-aa53-417cdc92bcbc req-30311a1f-7d43-4e64-985f-8d25e397ef82 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:32.468736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-d92cbf4a-b996-40fd-aa53-417cdc92bcbc req-30311a1f-7d43-4e64-985f-8d25e397ef82 service nova] Creating event network-changed:3388ca83-ec51-4aee-aede-a4637d3d327d for instance 406e22ef-2339-49fb-9f7f-3568a327b764 on hv-cinder-82016 Jan 21 13:52:32.474037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-d92cbf4a-b996-40fd-aa53-417cdc92bcbc req-30311a1f-7d43-4e64-985f-8d25e397ef82 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046171 Jan 21 13:52:32.474643 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 404/809] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:52:32.746584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-009dc2ff-7db8-449f-b017-216e5075007d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28661 microversion: 2.20 time: 1.678722 Jan 21 13:52:32.751018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 406/810] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:31 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28661 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:33.083332 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:33.084159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:33.090217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:33.090765 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:33.092319 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:33.092874 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:33.223633 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:33.230807 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bc824283-3d64-4005-8d44-fe289a6f09de tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.151587 Jan 21 13:52:33.231392 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 405/811] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:33 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:33.759037 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2b49a85b-c0bc-4fb3-b5ae-81c2be114833 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:33.760038 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2b49a85b-c0bc-4fb3-b5ae-81c2be114833 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:33.768368 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b49a85b-c0bc-4fb3-b5ae-81c2be114833 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:33.769752 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b49a85b-c0bc-4fb3-b5ae-81c2be114833 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:33.770567 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b49a85b-c0bc-4fb3-b5ae-81c2be114833 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:33.771013 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b49a85b-c0bc-4fb3-b5ae-81c2be114833 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:33.834808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2b49a85b-c0bc-4fb3-b5ae-81c2be114833 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.079648 Jan 21 13:52:33.838776 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 407/812] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:33 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:34.247777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:34.248390 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:34.254669 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:34.255113 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:34.255888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:34.256315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:34.386228 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:34.393366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-947a8b52-61b5-468f-bc96-f45a3f3f9023 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.149892 Jan 21 13:52:34.393942 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 406/813] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:34 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:34.789105 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-653034137", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-264786425", "security_groups": [{"name": "tempest-secgroup-smoke-2074969604"}], "block_device_mapping_v2": [{"uuid": "dea9bd37-2ea6-4934-ab4b-c8607ead3c1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "885b2ee1-8e97-4170-97ad-c321e8aa6294"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:34.847249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-eb57c822-21ff-4e00-9748-1a28531463fa tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:34.848171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-eb57c822-21ff-4e00-9748-1a28531463fa tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:34.854391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb57c822-21ff-4e00-9748-1a28531463fa tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:34.854843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb57c822-21ff-4e00-9748-1a28531463fa tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:34.855637 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb57c822-21ff-4e00-9748-1a28531463fa tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:34.856069 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eb57c822-21ff-4e00-9748-1a28531463fa tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:34.910099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] validate_networks() for [('885b2ee1-8e97-4170-97ad-c321e8aa6294', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:52:34.924399 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-eb57c822-21ff-4e00-9748-1a28531463fa tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.080756 Jan 21 13:52:34.925622 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 407/814] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:34 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:35.393676 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:52:35.394339 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:52:35.394822 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:52:35.395246 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:52:35.395662 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:52:35.405297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:35.405723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:35.406546 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:35.406987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:35.411869 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:35.412564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:35.421151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:35.421546 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:35.422333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:35.422777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:35.425360 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:52:35.432902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for user 0ae8a49f6ca54b8095d6ac95bd03bee0 and project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:52:35.500041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:52:35.502365 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dea9bd37-2ea6-4934-ab4b-c8607ead3c1c',volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:52:35.561914 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:35.569321 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d27732bf-cfa9-4034-a618-128d3b96bd8b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.162280 Jan 21 13:52:35.569902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 408/815] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:35 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:35.628011 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-70356873-ad51-4716-93e4-09f8c8f3d998 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842933 Jan 21 13:52:35.628656 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 408/816] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:52:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:52:35.638984 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-dc23a08d-0788-4a43-83c3-1cf1a8d9fbef tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:35.639717 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-dc23a08d-0788-4a43-83c3-1cf1a8d9fbef tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:35.698219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-dc23a08d-0788-4a43-83c3-1cf1a8d9fbef tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:35.706348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-dc23a08d-0788-4a43-83c3-1cf1a8d9fbef tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1093 microversion: 2.1 time: 0.071486 Jan 21 13:52:35.706924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 409/817] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:35 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:35.937942 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fe9e0205-1ba8-4814-ab95-716cddfacf16 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:35.939286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fe9e0205-1ba8-4814-ab95-716cddfacf16 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:35.946534 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe9e0205-1ba8-4814-ab95-716cddfacf16 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:35.947094 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe9e0205-1ba8-4814-ab95-716cddfacf16 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:35.948206 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe9e0205-1ba8-4814-ab95-716cddfacf16 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:35.948829 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe9e0205-1ba8-4814-ab95-716cddfacf16 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:36.585915 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:36.586520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:36.592970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:36.593417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:36.594183 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:36.594615 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:36.726819 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:36.734715 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8391e326-0fe5-4e6d-9c4c-27232c2e514f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.152599 Jan 21 13:52:36.735314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 410/818] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:36 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:36.739414 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:36.740013 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:36.745299 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:36.745744 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:36.746506 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:36.747587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:36.805053 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:36.812516 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6922b4ae-5f96-4c8b-8123-c82df2f7d7db tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1143 microversion: 2.1 time: 0.076277 Jan 21 13:52:36.813104 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 411/819] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:36 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1143 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:37.751888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:37.752551 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:37.758806 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:37.759260 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:37.760033 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:37.760473 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:37.881381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fe9e0205-1ba8-4814-ab95-716cddfacf16 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 28661 microversion: 2.20 time: 1.948250 Jan 21 13:52:37.885840 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 409/820] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:35 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 28661 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:37.887486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:37.888902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:37.895625 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:37.895846 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:37.896327 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:37.897331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:37.898059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:37.903995 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f19550a5-e337-4ba0-a43f-12bf982250ff tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.155525 Jan 21 13:52:37.904889 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 412/821] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:37 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:37.962948 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:37.971527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-919a4714-dcbf-4c45-9f98-cccd3d939979 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1143 microversion: 2.1 time: 0.088289 Jan 21 13:52:37.972296 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 410/822] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:37 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:38.274235 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-628833126", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "e3dbfaec-8cf8-41d4-873a-645beebf0141"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:38.323000 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] validate_networks() for [('e3dbfaec-8cf8-41d4-873a-645beebf0141', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:52:38.567721 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-6228f401-dbdb-499e-9d30-a795c7fc1a08 req-a7249042-a986-43d0-bb4b-204f485128cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406e22ef-2339-49fb-9f7f-3568a327b764", "name": "network-vif-plugged", "status": "completed", "tag": "3388ca83-ec51-4aee-aede-a4637d3d327d"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:38.570085 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:38.570085 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:52:38.578269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6228f401-dbdb-499e-9d30-a795c7fc1a08 req-a7249042-a986-43d0-bb4b-204f485128cc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:38.579107 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6228f401-dbdb-499e-9d30-a795c7fc1a08 req-a7249042-a986-43d0-bb4b-204f485128cc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:38.592405 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-6228f401-dbdb-499e-9d30-a795c7fc1a08 req-a7249042-a986-43d0-bb4b-204f485128cc service nova] Creating event network-vif-plugged:3388ca83-ec51-4aee-aede-a4637d3d327d for instance 406e22ef-2339-49fb-9f7f-3568a327b764 on hv-cinder-82016 Jan 21 13:52:38.598135 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-6228f401-dbdb-499e-9d30-a795c7fc1a08 req-a7249042-a986-43d0-bb4b-204f485128cc service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120795 Jan 21 13:52:38.598723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 411/823] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:38.796595 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:52:38.797137 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:52:38.797588 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:52:38.797996 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:52:38.798402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:52:38.810752 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:38.811203 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:38.812022 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:38.812465 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:38.829836 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Getting quotas for project f557e160058a4541b3abde466bd06c34. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:52:38.833908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Getting quotas for user b117cac4191e4366872cd1d1cee4087c and project f557e160058a4541b3abde466bd06c34. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:52:38.846011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:52:38.848342 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:52:38.896214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-850c4502-4f7e-42c9-862d-a849fdae34bf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:38.897690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-850c4502-4f7e-42c9-862d-a849fdae34bf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:38.908588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-850c4502-4f7e-42c9-862d-a849fdae34bf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:38.909340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-850c4502-4f7e-42c9-862d-a849fdae34bf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:38.910694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-850c4502-4f7e-42c9-862d-a849fdae34bf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:38.911445 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-850c4502-4f7e-42c9-862d-a849fdae34bf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:38.913159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-39cd82b3-b0cd-4591-8320-c54c6d0db0e9 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642356 Jan 21 13:52:38.915901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 413/824] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:52:38.925266 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:38.930011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:38.937149 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:38.938438 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:38.939748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:38.940205 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:39.098296 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:39.109136 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-971b1a7c-f4f4-4aff-80d0-583471d96058 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.186390 Jan 21 13:52:39.125012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 414/825] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:38 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:39.129535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9a91fdd7-8bc1-40da-a0c0-2c3642e527bc tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:39.135345 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9a91fdd7-8bc1-40da-a0c0-2c3642e527bc tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:39.210054 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9a91fdd7-8bc1-40da-a0c0-2c3642e527bc tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:39.219511 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-850c4502-4f7e-42c9-862d-a849fdae34bf tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 29718 microversion: 2.20 time: 0.329099 Jan 21 13:52:39.223722 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 412/826] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:38 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 29718 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:39.225117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:39.225821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:39.229417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9a91fdd7-8bc1-40da-a0c0-2c3642e527bc tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1218 microversion: 2.1 time: 0.102936 Jan 21 13:52:39.238719 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 415/827] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:39 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:39.239239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:39.239239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:39.239239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:39.239239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:39.501165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:39.512220 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ffd9862a-804d-4702-bc73-b26c5337c7e7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1277 microversion: 2.1 time: 0.290724 Jan 21 13:52:39.512877 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 413/828] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:39 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1277 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:40.143471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:40.144211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:40.150868 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.151425 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.152572 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.153287 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.232136 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5d0ca964-c82e-4e82-827c-5529f1bce6a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:40.233273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5d0ca964-c82e-4e82-827c-5529f1bce6a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:40.246210 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d0ca964-c82e-4e82-827c-5529f1bce6a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.248867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d0ca964-c82e-4e82-827c-5529f1bce6a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.249913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d0ca964-c82e-4e82-827c-5529f1bce6a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.250387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5d0ca964-c82e-4e82-827c-5529f1bce6a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.306488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:40.314738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-78c0b547-5de7-4d61-af58-c30ab74cc968 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1362 microversion: 2.1 time: 0.176172 Jan 21 13:52:40.315423 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 416/829] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:40 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:40.320109 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:40.320851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:40.326793 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.327344 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.328200 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.328754 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.363470 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5d0ca964-c82e-4e82-827c-5529f1bce6a6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 31011 microversion: 2.20 time: 0.135677 Jan 21 13:52:40.365060 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 414/830] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:40 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 31011 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:40.380645 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-16c99025-cd55-4038-bdbc-ee8deac56b37 req-8f494f06-c891-4134-949e-acf982c6072d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b269ee40-e090-4ad6-a652-0188bd06fa08", "tag": "50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:40.383124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:40.383124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:52:40.393597 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-16c99025-cd55-4038-bdbc-ee8deac56b37 req-8f494f06-c891-4134-949e-acf982c6072d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.394081 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-16c99025-cd55-4038-bdbc-ee8deac56b37 req-8f494f06-c891-4134-949e-acf982c6072d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.413024 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-16c99025-cd55-4038-bdbc-ee8deac56b37 req-8f494f06-c891-4134-949e-acf982c6072d service nova] Creating event network-changed:50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb for instance b269ee40-e090-4ad6-a652-0188bd06fa08 on hv-cinder-82016 Jan 21 13:52:40.416799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:40.426884 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-705475af-b786-4ba7-8bb7-f1843760d074 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1276 microversion: 2.1 time: 0.109658 Jan 21 13:52:40.427785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 417/831] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:40 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:40.430916 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-16c99025-cd55-4038-bdbc-ee8deac56b37 req-8f494f06-c891-4134-949e-acf982c6072d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062651 Jan 21 13:52:40.431826 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 415/832] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:40.530949 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:40.532086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:40.538246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.538700 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.539500 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:40.540119 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:40.687743 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:40.695376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7c9498b4-a147-4295-a6b3-01bb14b0b1ba tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.169332 Jan 21 13:52:40.695958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 418/833] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:40 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:41.333805 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:41.334643 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:41.342920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.343761 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.344983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.346793 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.375894 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d0e0e2a0-0ab4-4eff-ba54-074ee1a6ffe4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:41.376963 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d0e0e2a0-0ab4-4eff-ba54-074ee1a6ffe4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:41.382879 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2a0-0ab4-4eff-ba54-074ee1a6ffe4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.383556 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2a0-0ab4-4eff-ba54-074ee1a6ffe4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.384528 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2a0-0ab4-4eff-ba54-074ee1a6ffe4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.385057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2a0-0ab4-4eff-ba54-074ee1a6ffe4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.497989 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d0e0e2a0-0ab4-4eff-ba54-074ee1a6ffe4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 32767 microversion: 2.20 time: 0.126223 Jan 21 13:52:41.498648 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 419/834] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:41 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 32767 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:41.503429 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:41.504115 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:41.511128 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.511577 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.512985 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.513717 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.644407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:41.652474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8aed6f9e-2833-47d3-89b3-c16287ad059a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1318 microversion: 2.1 time: 0.152467 Jan 21 13:52:41.653170 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 420/835] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:41 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:41.678538 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:41.686952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ba1a4d01-a365-417a-b217-9f5230807769 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1547 microversion: 2.1 time: 0.358472 Jan 21 13:52:41.687525 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 416/836] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:41 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1547 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:41.704184 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c275158b-fb11-4706-af4e-0f6a16e1b077 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:41.704698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c275158b-fb11-4706-af4e-0f6a16e1b077 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:41.711168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c275158b-fb11-4706-af4e-0f6a16e1b077 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.711842 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c275158b-fb11-4706-af4e-0f6a16e1b077 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.712147 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:41.712879 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:41.713056 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c275158b-fb11-4706-af4e-0f6a16e1b077 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.713663 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c275158b-fb11-4706-af4e-0f6a16e1b077 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.719043 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.719567 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.720597 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:41.721132 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:41.801433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c275158b-fb11-4706-af4e-0f6a16e1b077 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101820 Jan 21 13:52:41.802141 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 421/837] 10.222.0.84 () {58 vars in 1274 bytes} [Fri Jan 21 13:52:41 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:42.049023 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:42.056383 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-57c58911-c7b6-434d-9145-e5c397ee413d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.348124 Jan 21 13:52:42.070327 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 417/838] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:41 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:42.510969 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-af4a55f2-cfae-42e8-82dc-c0e0626023d3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:42.512132 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-af4a55f2-cfae-42e8-82dc-c0e0626023d3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:42.521165 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-af4a55f2-cfae-42e8-82dc-c0e0626023d3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:42.521626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-af4a55f2-cfae-42e8-82dc-c0e0626023d3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:42.522561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-af4a55f2-cfae-42e8-82dc-c0e0626023d3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:42.523313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-af4a55f2-cfae-42e8-82dc-c0e0626023d3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:42.530028 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-ea483080-b31c-43a9-b63f-45947d1ed0df req-19119382-19f8-45e7-be8c-6692fed768e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8a3664-f9a3-4171-ae3c-3fc6b50183fb", "tag": "70597764-bc7e-41c2-b76d-a135aaa88df6"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:42.532504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:42.532504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:52:42.542170 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ea483080-b31c-43a9-b63f-45947d1ed0df req-19119382-19f8-45e7-be8c-6692fed768e6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:42.549311 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ea483080-b31c-43a9-b63f-45947d1ed0df req-19119382-19f8-45e7-be8c-6692fed768e6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:42.576931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-ea483080-b31c-43a9-b63f-45947d1ed0df req-19119382-19f8-45e7-be8c-6692fed768e6 service nova] Creating event network-changed:70597764-bc7e-41c2-b76d-a135aaa88df6 for instance 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb on hv-cinder-82016 Jan 21 13:52:42.582031 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-ea483080-b31c-43a9-b63f-45947d1ed0df req-19119382-19f8-45e7-be8c-6692fed768e6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055596 Jan 21 13:52:42.582898 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 418/839] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:52:42.639937 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-af4a55f2-cfae-42e8-82dc-c0e0626023d3 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 33673 microversion: 2.20 time: 0.133165 Jan 21 13:52:42.641384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 422/840] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:42 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 33673 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:42.671109 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:42.671823 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:42.678794 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:42.679247 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:42.680037 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:42.680473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:42.932632 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:42.940517 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-035d758f-a727-4782-b14e-91cc246b1393 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1318 microversion: 2.1 time: 0.275082 Jan 21 13:52:42.941124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 419/841] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:42 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:43.047309 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-053b40e3-fb18-434b-84d2-dbf170917e9a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:43.048369 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-053b40e3-fb18-434b-84d2-dbf170917e9a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:43.059488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-053b40e3-fb18-434b-84d2-dbf170917e9a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.060349 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-053b40e3-fb18-434b-84d2-dbf170917e9a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.061446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-053b40e3-fb18-434b-84d2-dbf170917e9a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.062064 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-053b40e3-fb18-434b-84d2-dbf170917e9a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.118303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-6666a76a-33cb-438e-a8ec-4bed92b9fb6b req-6e2e9a58-94a6-4177-8de2-9a2925d9f4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406e22ef-2339-49fb-9f7f-3568a327b764", "tag": "3388ca83-ec51-4aee-aede-a4637d3d327d"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:43.120047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:43.120047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:52:43.128106 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6666a76a-33cb-438e-a8ec-4bed92b9fb6b req-6e2e9a58-94a6-4177-8de2-9a2925d9f4fc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.128650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6666a76a-33cb-438e-a8ec-4bed92b9fb6b req-6e2e9a58-94a6-4177-8de2-9a2925d9f4fc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.142742 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-6666a76a-33cb-438e-a8ec-4bed92b9fb6b req-6e2e9a58-94a6-4177-8de2-9a2925d9f4fc service nova] Creating event network-changed:3388ca83-ec51-4aee-aede-a4637d3d327d for instance 406e22ef-2339-49fb-9f7f-3568a327b764 on hv-cinder-82016 Jan 21 13:52:43.143708 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-053b40e3-fb18-434b-84d2-dbf170917e9a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.105192 Jan 21 13:52:43.147351 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 423/842] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:43 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:43.150642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:43.151465 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:43.153997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-6666a76a-33cb-438e-a8ec-4bed92b9fb6b req-6e2e9a58-94a6-4177-8de2-9a2925d9f4fc service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110489 Jan 21 13:52:43.154935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 420/843] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:43.162620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.163287 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.164416 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.165069 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.318880 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:43.329409 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-87dc23c1-54fe-4936-a643-5b2f7f4c6d50 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.183077 Jan 21 13:52:43.338494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 424/844] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:43 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:43.652016 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-43ca79c8-4a54-4244-b448-7ac37a3e55bb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:43.654170 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-43ca79c8-4a54-4244-b448-7ac37a3e55bb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:43.661567 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43ca79c8-4a54-4244-b448-7ac37a3e55bb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.662900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43ca79c8-4a54-4244-b448-7ac37a3e55bb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.663704 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43ca79c8-4a54-4244-b448-7ac37a3e55bb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.664354 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43ca79c8-4a54-4244-b448-7ac37a3e55bb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.748272 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-43ca79c8-4a54-4244-b448-7ac37a3e55bb tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 34714 microversion: 2.20 time: 0.098764 Jan 21 13:52:43.752576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 421/845] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:43 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 34714 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:43.958774 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:43.959526 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:43.966469 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.967019 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:43.967921 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:43.968443 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:44.104433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:44.113756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7b998ff4-1e47-439c-9971-704fc1042595 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1318 microversion: 2.1 time: 0.159331 Jan 21 13:52:44.114541 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 425/846] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:43 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:44.156144 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e0cb7140-1deb-460d-bcd8-dcbd652e1b1a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:44.157552 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e0cb7140-1deb-460d-bcd8-dcbd652e1b1a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:44.164791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0cb7140-1deb-460d-bcd8-dcbd652e1b1a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:44.165332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0cb7140-1deb-460d-bcd8-dcbd652e1b1a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:44.166358 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0cb7140-1deb-460d-bcd8-dcbd652e1b1a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:44.167014 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0cb7140-1deb-460d-bcd8-dcbd652e1b1a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:44.230557 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e0cb7140-1deb-460d-bcd8-dcbd652e1b1a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.080032 Jan 21 13:52:44.231754 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 422/847] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:44 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:44.346509 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:44.347126 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:44.353413 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:44.353807 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:44.354588 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:44.355028 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:44.489851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:44.498714 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4759cba2-e8bc-4ca7-a4be-b80a18bfad58 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.155836 Jan 21 13:52:44.499300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 426/848] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:44 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:44.760721 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c0a2e914-73bc-46ac-9fbe-be77903ffd8d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:44.761727 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c0a2e914-73bc-46ac-9fbe-be77903ffd8d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:44.769288 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0a2e914-73bc-46ac-9fbe-be77903ffd8d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:44.769740 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0a2e914-73bc-46ac-9fbe-be77903ffd8d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:44.770527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0a2e914-73bc-46ac-9fbe-be77903ffd8d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:44.770961 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c0a2e914-73bc-46ac-9fbe-be77903ffd8d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:44.843446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c0a2e914-73bc-46ac-9fbe-be77903ffd8d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 35688 microversion: 2.20 time: 0.086666 Jan 21 13:52:44.844152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 423/849] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:44 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 35688 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:45.131170 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:45.131785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:45.138826 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.139275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.140084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.140523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.242285 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ca80acec-54f3-423f-a408-555f137bcc43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:45.243516 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ca80acec-54f3-423f-a408-555f137bcc43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:45.251190 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca80acec-54f3-423f-a408-555f137bcc43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.251639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca80acec-54f3-423f-a408-555f137bcc43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.252452 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca80acec-54f3-423f-a408-555f137bcc43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.252928 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca80acec-54f3-423f-a408-555f137bcc43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.268467 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:45.275629 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7def8693-6f51-48d6-beed-fb1cc3a8475c tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1318 microversion: 2.1 time: 0.148124 Jan 21 13:52:45.276196 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 427/850] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:45 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:45.321292 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ca80acec-54f3-423f-a408-555f137bcc43 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.082774 Jan 21 13:52:45.321842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 424/851] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:45 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:52:45.515375 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:45.515978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:45.521832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.522282 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.523051 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.523486 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.656158 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:45.663395 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6bd482fa-0715-409c-8e7a-2176a094ac31 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.152143 Jan 21 13:52:45.663961 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 428/852] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:45 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:45.855664 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-64a2bd48-10af-47f9-885a-828220717a7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:45.857476 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-64a2bd48-10af-47f9-885a-828220717a7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:45.864651 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64a2bd48-10af-47f9-885a-828220717a7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.865108 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64a2bd48-10af-47f9-885a-828220717a7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.865960 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64a2bd48-10af-47f9-885a-828220717a7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:45.866400 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64a2bd48-10af-47f9-885a-828220717a7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:45.937266 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-64a2bd48-10af-47f9-885a-828220717a7d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 37033 microversion: 2.20 time: 0.085688 Jan 21 13:52:45.937904 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 425/853] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:45 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 37033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:46.293908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:46.294515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:46.300771 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.301228 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.302005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.302445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.332372 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3efa55ff-574a-4bae-bc61-24b07afeea0c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:46.333403 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3efa55ff-574a-4bae-bc61-24b07afeea0c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:46.340512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3efa55ff-574a-4bae-bc61-24b07afeea0c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.341277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3efa55ff-574a-4bae-bc61-24b07afeea0c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.342082 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3efa55ff-574a-4bae-bc61-24b07afeea0c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.342523 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3efa55ff-574a-4bae-bc61-24b07afeea0c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.406047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3efa55ff-574a-4bae-bc61-24b07afeea0c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.077497 Jan 21 13:52:46.406894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 426/854] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:46 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:52:46.438625 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:46.445851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2fb17dd5-2f6b-4bab-9367-a4ccd0dea473 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1318 microversion: 2.1 time: 0.156151 Jan 21 13:52:46.446426 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 429/855] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:46 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:46.492528 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-8afd6575-abaa-4638-90b8-19fc5c0616c0 req-b91c7e3a-4f26-4cd3-9e75-ec1bde811bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a3664-f9a3-4171-ae3c-3fc6b50183fb", "name": "network-vif-plugged", "status": "completed", "tag": "70597764-bc7e-41c2-b76d-a135aaa88df6"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:46.494053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:46.494053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:52:46.503536 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-8afd6575-abaa-4638-90b8-19fc5c0616c0 req-b91c7e3a-4f26-4cd3-9e75-ec1bde811bf7 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.503987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-8afd6575-abaa-4638-90b8-19fc5c0616c0 req-b91c7e3a-4f26-4cd3-9e75-ec1bde811bf7 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.518822 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-8afd6575-abaa-4638-90b8-19fc5c0616c0 req-b91c7e3a-4f26-4cd3-9e75-ec1bde811bf7 service nova] Creating event network-vif-plugged:70597764-bc7e-41c2-b76d-a135aaa88df6 for instance 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb on hv-cinder-82016 Jan 21 13:52:46.523539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-8afd6575-abaa-4638-90b8-19fc5c0616c0 req-b91c7e3a-4f26-4cd3-9e75-ec1bde811bf7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035276 Jan 21 13:52:46.524178 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 427/856] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:46.679733 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:46.680341 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:46.686216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.686665 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.687446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.687880 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.950608 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-eb2bd29b-7665-40ac-b847-d5d1167b3572 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:46.951608 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-eb2bd29b-7665-40ac-b847-d5d1167b3572 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:46.957565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb2bd29b-7665-40ac-b847-d5d1167b3572 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.958010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb2bd29b-7665-40ac-b847-d5d1167b3572 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.958786 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb2bd29b-7665-40ac-b847-d5d1167b3572 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:46.959222 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb2bd29b-7665-40ac-b847-d5d1167b3572 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:46.969009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:46.976277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-015a9447-fa1e-4665-9c03-7aae2b8695d7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.300189 Jan 21 13:52:46.976874 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 430/857] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:46 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:47.043650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-eb2bd29b-7665-40ac-b847-d5d1167b3572 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 38211 microversion: 2.20 time: 0.097871 Jan 21 13:52:47.044671 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 428/858] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:46 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 38211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:47.417198 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f5cecfae-2b76-4449-81fd-dbbbce9c6e0d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:47.418040 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f5cecfae-2b76-4449-81fd-dbbbce9c6e0d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:47.424419 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5cecfae-2b76-4449-81fd-dbbbce9c6e0d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:47.424978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5cecfae-2b76-4449-81fd-dbbbce9c6e0d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:47.425762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5cecfae-2b76-4449-81fd-dbbbce9c6e0d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:47.426204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f5cecfae-2b76-4449-81fd-dbbbce9c6e0d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:47.462720 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:47.463408 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:47.470438 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:47.470866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:47.471639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:47.472077 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:47.487275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f5cecfae-2b76-4449-81fd-dbbbce9c6e0d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.073532 Jan 21 13:52:47.490478 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 431/859] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:47 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:47.604155 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:47.611838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-59ca01bb-dec4-45f7-acc8-110c51fe1f1a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1318 microversion: 2.1 time: 0.153160 Jan 21 13:52:47.612406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 429/860] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:47 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:47.993575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:47.994186 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:48.002084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.002532 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.003315 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.003752 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.055347 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8c390674-55de-4215-a68c-37ac4f7e7c9e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:48.056297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8c390674-55de-4215-a68c-37ac4f7e7c9e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:48.063798 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c390674-55de-4215-a68c-37ac4f7e7c9e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.064253 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c390674-55de-4215-a68c-37ac4f7e7c9e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.065074 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c390674-55de-4215-a68c-37ac4f7e7c9e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.065510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8c390674-55de-4215-a68c-37ac4f7e7c9e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.129974 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8c390674-55de-4215-a68c-37ac4f7e7c9e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 38211 microversion: 2.20 time: 0.078129 Jan 21 13:52:48.130662 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 430/861] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:48 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 38211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:52:48.143468 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:48.155802 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a1ed34af-4ec9-43ad-8fa5-fe14603325a4 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.166418 Jan 21 13:52:48.156396 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 432/862] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:47 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:48.498322 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e728c8e2-ff8a-49e6-8928-6369796ad7e7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:48.499328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e728c8e2-ff8a-49e6-8928-6369796ad7e7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:48.506520 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e728c8e2-ff8a-49e6-8928-6369796ad7e7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.506981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e728c8e2-ff8a-49e6-8928-6369796ad7e7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.507771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e728c8e2-ff8a-49e6-8928-6369796ad7e7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.508215 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e728c8e2-ff8a-49e6-8928-6369796ad7e7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.570565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e728c8e2-ff8a-49e6-8928-6369796ad7e7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.076091 Jan 21 13:52:48.573668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 431/863] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:48 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:48.628471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:48.629149 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:48.635392 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.635850 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.636653 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.637575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.768799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:48.775940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f2e4c07e-b43d-4cc4-8cdf-845247101352 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1508 microversion: 2.1 time: 0.151113 Jan 21 13:52:48.776497 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 433/864] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:48 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:48.793005 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-05a8f736-e476-4cbe-afb6-27a06d79d70d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a76505-a8ad-4ba9-b699-538c75032f66", "device": "/dev/sdb"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:48.795168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-05a8f736-e476-4cbe-afb6-27a06d79d70d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:48.802138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05a8f736-e476-4cbe-afb6-27a06d79d70d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.802593 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05a8f736-e476-4cbe-afb6-27a06d79d70d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:48.803379 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05a8f736-e476-4cbe-afb6-27a06d79d70d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:48.803819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05a8f736-e476-4cbe-afb6-27a06d79d70d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:49.033679 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-05a8f736-e476-4cbe-afb6-27a06d79d70d tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "POST /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244698 Jan 21 13:52:49.034397 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 432/865] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:52:48 2022] POST /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:49.141535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-67c9671f-01d0-43ba-bbbd-9b7daf39fab4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:49.142476 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-67c9671f-01d0-43ba-bbbd-9b7daf39fab4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:49.148697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-67c9671f-01d0-43ba-bbbd-9b7daf39fab4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:49.148697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-67c9671f-01d0-43ba-bbbd-9b7daf39fab4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:49.149522 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-67c9671f-01d0-43ba-bbbd-9b7daf39fab4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:49.149964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-67c9671f-01d0-43ba-bbbd-9b7daf39fab4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:49.173424 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:49.174122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:49.180236 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:49.180806 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:49.181596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:49.182036 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:49.212199 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-67c9671f-01d0-43ba-bbbd-9b7daf39fab4 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 38211 microversion: 2.20 time: 0.074716 Jan 21 13:52:49.212900 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 434/866] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:49 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 38211 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:49.315989 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:49.323404 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-04a9f442-7f7f-4901-974b-4f8c070c8832 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.155299 Jan 21 13:52:49.323993 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 433/867] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:49 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:49.581946 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-96572d27-26b9-4f51-b7ea-8787702d4a38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:49.582933 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-96572d27-26b9-4f51-b7ea-8787702d4a38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:49.589688 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-96572d27-26b9-4f51-b7ea-8787702d4a38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:49.590748 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-96572d27-26b9-4f51-b7ea-8787702d4a38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:49.591551 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-96572d27-26b9-4f51-b7ea-8787702d4a38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:49.591970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-96572d27-26b9-4f51-b7ea-8787702d4a38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:49.650831 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-96572d27-26b9-4f51-b7ea-8787702d4a38 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.072692 Jan 21 13:52:49.651464 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 435/868] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:49 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:50.224929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-76a9f26c-7da2-425c-9d81-f749307b22af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:50.225901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-76a9f26c-7da2-425c-9d81-f749307b22af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:50.232851 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76a9f26c-7da2-425c-9d81-f749307b22af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:50.233306 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76a9f26c-7da2-425c-9d81-f749307b22af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:50.234089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76a9f26c-7da2-425c-9d81-f749307b22af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:50.234527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76a9f26c-7da2-425c-9d81-f749307b22af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:50.305448 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-76a9f26c-7da2-425c-9d81-f749307b22af tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 38225 microversion: 2.20 time: 0.083998 Jan 21 13:52:50.306216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 434/869] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:50 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 38225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:50.342121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:50.344033 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:50.351086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:50.351537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:50.352322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:50.352783 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:50.494403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:50.501801 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0576372c-67a7-4898-b185-aecde297a97c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.164499 Jan 21 13:52:50.502459 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 436/870] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:50 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:50.516286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-bb60c690-8aad-4179-b82e-b6875e088442 req-7b53e16e-66bc-4c32-ac9b-457eeddf4ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b269ee40-e090-4ad6-a652-0188bd06fa08", "name": "network-vif-plugged", "status": "completed", "tag": "50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:50.517886 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:50.517886 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:52:50.526155 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-bb60c690-8aad-4179-b82e-b6875e088442 req-7b53e16e-66bc-4c32-ac9b-457eeddf4ff6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:50.526614 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-bb60c690-8aad-4179-b82e-b6875e088442 req-7b53e16e-66bc-4c32-ac9b-457eeddf4ff6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:50.538450 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-bb60c690-8aad-4179-b82e-b6875e088442 req-7b53e16e-66bc-4c32-ac9b-457eeddf4ff6 service nova] Creating event network-vif-plugged:50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb for instance b269ee40-e090-4ad6-a652-0188bd06fa08 on hv-cinder-82016 Jan 21 13:52:50.543080 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-bb60c690-8aad-4179-b82e-b6875e088442 req-7b53e16e-66bc-4c32-ac9b-457eeddf4ff6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030980 Jan 21 13:52:50.544535 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 435/871] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:52:50.662719 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b8e1f92b-0203-4688-b4b1-739fca168cd9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:50.663624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b8e1f92b-0203-4688-b4b1-739fca168cd9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:50.670153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b8e1f92b-0203-4688-b4b1-739fca168cd9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:50.670611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b8e1f92b-0203-4688-b4b1-739fca168cd9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:50.671399 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b8e1f92b-0203-4688-b4b1-739fca168cd9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:50.672023 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b8e1f92b-0203-4688-b4b1-739fca168cd9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:50.743161 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b8e1f92b-0203-4688-b4b1-739fca168cd9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.084198 Jan 21 13:52:50.743931 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 437/872] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:50 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:51.319180 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a21c668e-bb99-4489-8be8-af71a6421c0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:51.320184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a21c668e-bb99-4489-8be8-af71a6421c0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:51.326913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a21c668e-bb99-4489-8be8-af71a6421c0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.327354 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a21c668e-bb99-4489-8be8-af71a6421c0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.328117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a21c668e-bb99-4489-8be8-af71a6421c0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.328543 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a21c668e-bb99-4489-8be8-af71a6421c0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.404187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a21c668e-bb99-4489-8be8-af71a6421c0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 200 len: 38352 microversion: 2.20 time: 0.089236 Jan 21 13:52:51.404745 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 436/873] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:51 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 38352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:51.415082 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8370deaf-e31d-43af-b580-b70d2e7c106e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:51.415674 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8370deaf-e31d-43af-b580-b70d2e7c106e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:51.422574 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8370deaf-e31d-43af-b580-b70d2e7c106e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.423031 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8370deaf-e31d-43af-b580-b70d2e7c106e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.423813 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8370deaf-e31d-43af-b580-b70d2e7c106e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.424253 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8370deaf-e31d-43af-b580-b70d2e7c106e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.448490 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8370deaf-e31d-43af-b580-b70d2e7c106e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/ips" status: 200 len: 152 microversion: 2.20 time: 0.037520 Jan 21 13:52:51.449074 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 438/874] 10.222.0.84 () {60 vars in 1288 bytes} [Fri Jan 21 13:52:51 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:52:51.518736 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:51.519444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:51.526376 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.526831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.528155 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.528338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.669181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:51.677101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fdc302fa-40e8-4a70-9fa6-ceefbe572a96 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1265 microversion: 2.1 time: 0.162290 Jan 21 13:52:51.677950 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 437/875] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:51 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:51.754249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2fab0de2-0b8f-4a2d-ac14-673c73cc1988 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:51.755204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2fab0de2-0b8f-4a2d-ac14-673c73cc1988 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:51.762214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fab0de2-0b8f-4a2d-ac14-673c73cc1988 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.762785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fab0de2-0b8f-4a2d-ac14-673c73cc1988 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.763807 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fab0de2-0b8f-4a2d-ac14-673c73cc1988 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:51.764308 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2fab0de2-0b8f-4a2d-ac14-673c73cc1988 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:51.829247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2fab0de2-0b8f-4a2d-ac14-673c73cc1988 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.078425 Jan 21 13:52:51.829940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 439/876] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:51 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:52:52.694428 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:52.695040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:52.701446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:52.701896 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:52.702672 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:52.703111 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:52.832465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:52.839647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9f29d8d8-0c06-436f-adff-10596cc39045 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:52.841175 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9f29d8d8-0c06-436f-adff-10596cc39045 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:52.842412 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7bd43124-de53-48c2-89ee-e993960e11c5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1452 microversion: 2.1 time: 0.151580 Jan 21 13:52:52.842988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 438/877] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:52 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:52.848028 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f29d8d8-0c06-436f-adff-10596cc39045 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:52.848484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f29d8d8-0c06-436f-adff-10596cc39045 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:52.849306 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f29d8d8-0c06-436f-adff-10596cc39045 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:52.849751 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9f29d8d8-0c06-436f-adff-10596cc39045 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:52.858486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:52.859092 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:52.865012 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:52.865459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:52.866236 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:52.866670 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:52.914157 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9f29d8d8-0c06-436f-adff-10596cc39045 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 14 microversion: 2.1 time: 0.078209 Jan 21 13:52:52.917379 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 440/878] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:52 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 13:52:52.999915 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:53.007214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9450d5b1-6233-49e5-b42d-5899f7ecd077 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1452 microversion: 2.1 time: 0.153167 Jan 21 13:52:53.007791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 439/879] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:52 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:53.585865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:53.586493 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:53.594000 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:53.594459 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:53.595275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:53.595712 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:53.618920 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lazy-loading 'flavor' on Instance uuid 09f409b3-10f8-4920-b146-2587110be8f6 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:52:53.881504 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b146f136-d61a-4228-a9fb-1f7cb128a5df tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 202 len: 0 microversion: 2.20 time: 0.299530 Jan 21 13:52:53.882338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 441/880] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:52:53 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:52:53.892198 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:53.892895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:53.899559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:53.900014 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:53.900846 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:53.901295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:53.928378 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1ae276b6-cf03-47f9-8167-4f2bc05c2f4a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:53.929478 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1ae276b6-cf03-47f9-8167-4f2bc05c2f4a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:53.936761 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ae276b6-cf03-47f9-8167-4f2bc05c2f4a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:53.937223 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ae276b6-cf03-47f9-8167-4f2bc05c2f4a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:53.938020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ae276b6-cf03-47f9-8167-4f2bc05c2f4a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:53.938601 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ae276b6-cf03-47f9-8167-4f2bc05c2f4a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:54.036401 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1ae276b6-cf03-47f9-8167-4f2bc05c2f4a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 8925 microversion: 2.1 time: 0.114015 Jan 21 13:52:54.037077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 442/881] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:53 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 8925 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:52:54.144656 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:54.154032 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:54.155563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:54.156757 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a2b2706e-aeb7-4e9b-82cb-f2f496d57028 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.270316 Jan 21 13:52:54.157329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 440/882] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:52:53 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:52:54.745387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-b0687c26-f7e9-4871-9bc8-3db496800c4e req-988a4747-a91b-451d-9c10-fb6910a61d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b269ee40-e090-4ad6-a652-0188bd06fa08", "tag": "50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:54.745892 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:52:54.745892 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:52:54.753953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b0687c26-f7e9-4871-9bc8-3db496800c4e req-988a4747-a91b-451d-9c10-fb6910a61d9f service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:54.754394 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b0687c26-f7e9-4871-9bc8-3db496800c4e req-988a4747-a91b-451d-9c10-fb6910a61d9f service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:54.765775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-b0687c26-f7e9-4871-9bc8-3db496800c4e req-988a4747-a91b-451d-9c10-fb6910a61d9f service nova] Creating event network-changed:50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb for instance b269ee40-e090-4ad6-a652-0188bd06fa08 on hv-cinder-82016 Jan 21 13:52:54.770482 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-b0687c26-f7e9-4871-9bc8-3db496800c4e req-988a4747-a91b-451d-9c10-fb6910a61d9f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030030 Jan 21 13:52:54.771073 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 443/883] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:52:55.047467 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4fd6f318-5da7-4cf0-9dfb-3087d3ebd96e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:55.049224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4fd6f318-5da7-4cf0-9dfb-3087d3ebd96e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:55.055555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fd6f318-5da7-4cf0-9dfb-3087d3ebd96e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:55.056009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fd6f318-5da7-4cf0-9dfb-3087d3ebd96e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:55.056841 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fd6f318-5da7-4cf0-9dfb-3087d3ebd96e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:55.057281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fd6f318-5da7-4cf0-9dfb-3087d3ebd96e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:55.150735 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4fd6f318-5da7-4cf0-9dfb-3087d3ebd96e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 15025 microversion: 2.1 time: 0.106794 Jan 21 13:52:55.152986 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 441/884] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:55 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 15025 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:52:55.177114 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:55.178323 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:55.186264 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:55.187553 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:55.188721 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:55.189520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:55.337055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:55.346224 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:55.348069 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:55.349481 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bc7932e2-8bac-41ea-91a8-bbcbf165ecd7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.177282 Jan 21 13:52:55.350296 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 444/885] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:52:55 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:52:56.164289 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-37849470-7018-4d47-b1f8-f4a07c965c03 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:56.165319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-37849470-7018-4d47-b1f8-f4a07c965c03 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:56.172366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-37849470-7018-4d47-b1f8-f4a07c965c03 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:56.172856 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-37849470-7018-4d47-b1f8-f4a07c965c03 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:56.173639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-37849470-7018-4d47-b1f8-f4a07c965c03 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:56.174084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-37849470-7018-4d47-b1f8-f4a07c965c03 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:56.245063 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-37849470-7018-4d47-b1f8-f4a07c965c03 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 18398 microversion: 2.1 time: 0.084766 Jan 21 13:52:56.245678 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 442/886] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:56 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 18398 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:52:56.368670 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:56.369258 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:56.376123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:56.376571 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:56.377372 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:56.377809 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:56.510080 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:56.517676 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:56.519172 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:56.520312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d4b526ee-feb6-4980-ab5b-55e07a239d37 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.155399 Jan 21 13:52:56.520899 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 445/887] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:52:56 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:52:57.213361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:57.213987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:57.221245 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.221699 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.222478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.222917 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.244817 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lazy-loading 'flavor' on Instance uuid 591899e6-cf08-42d3-9b97-59bfd88f7fa6 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:52:57.255338 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f767f2b9-cba6-4a0a-a4cc-b59a3f0b54ca tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:52:57.256237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f767f2b9-cba6-4a0a-a4cc-b59a3f0b54ca tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:57.263143 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f767f2b9-cba6-4a0a-a4cc-b59a3f0b54ca tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.263589 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f767f2b9-cba6-4a0a-a4cc-b59a3f0b54ca tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.264361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f767f2b9-cba6-4a0a-a4cc-b59a3f0b54ca tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.264835 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f767f2b9-cba6-4a0a-a4cc-b59a3f0b54ca tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.318206 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-525acd80-8491-41a0-b1e8-dcd618202a03 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "POST /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6/action" status: 202 len: 0 microversion: 2.1 time: 0.108672 Jan 21 13:52:57.319143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 443/888] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:57 2022] POST /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:52:57.327991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:57.328745 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:57.334635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.335089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.335870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.336309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.469843 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:57.478369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-aea850c9-8dd5-4c7b-ac53-13da2382ed61 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.154833 Jan 21 13:52:57.478943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 444/889] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:57 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:57.539004 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:57.539606 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:57.545803 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.546259 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.547044 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:57.547487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:57.675546 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:57.683164 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:57.685234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:57.686446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1bc86a5e-e784-46d8-9f8f-a214e35dd61e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.150916 Jan 21 13:52:57.687006 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 445/890] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:52:57 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:52:58.495858 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:58.496566 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:58.503348 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:58.503806 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:58.504590 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:58.505062 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:58.638046 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:58.645353 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7b110302-cac5-4982-91a9-f80f8c39715c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.153200 Jan 21 13:52:58.646325 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 446/891] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:58 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:58.703430 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:58.704034 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:58.709874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:58.710320 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:58.711087 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:58.711521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:58.840161 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:58.847842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:58.849378 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:58.850521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2c1fa695-0bf0-463e-90e3-51979f749a75 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.150776 Jan 21 13:52:58.851069 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 447/892] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:52:58 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:52:59.662945 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:59.663592 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:59.665695 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f767f2b9-cba6-4a0a-a4cc-b59a3f0b54ca tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 22975 microversion: 2.1 time: 2.413688 Jan 21 13:52:59.669573 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 446/893] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:52:57 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 22975 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:52:59.670086 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:59.670543 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:59.671330 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:59.671767 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:59.813902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:52:59.821195 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-40fc7b77-835b-48a0-8610-c5d157f37509 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.161894 Jan 21 13:52:59.821755 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 448/894] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:52:59 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:52:59.869578 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:52:59.870282 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:52:59.877808 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:59.878262 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:52:59.879047 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:52:59.879486 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:00.010872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:00.019154 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:00.020670 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:00.021823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e4963fbd-5702-49d6-b0ae-7f455d2aa282 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.156320 Jan 21 13:53:00.022377 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 447/895] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:52:59 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:00.677184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bf66ded2-e911-49a1-83e2-62e6bf1ab812 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:00.678092 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bf66ded2-e911-49a1-83e2-62e6bf1ab812 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:00.685556 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf66ded2-e911-49a1-83e2-62e6bf1ab812 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:00.686008 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf66ded2-e911-49a1-83e2-62e6bf1ab812 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:00.686791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf66ded2-e911-49a1-83e2-62e6bf1ab812 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:00.687229 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf66ded2-e911-49a1-83e2-62e6bf1ab812 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:00.771085 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bf66ded2-e911-49a1-83e2-62e6bf1ab812 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 23798 microversion: 2.1 time: 0.097336 Jan 21 13:53:00.771755 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 449/896] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:00 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 23798 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:00.839273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:00.840641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:00.847513 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:00.847975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:00.848868 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:00.849310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:01.005325 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:01.013297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f03dc23d-fff2-4cd2-84e4-9544141eed39 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.177928 Jan 21 13:53:01.013847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 448/897] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:00 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:01.040681 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:01.041406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:01.048226 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:01.048705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:01.049478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:01.049913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:01.179669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:01.187813 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:01.189395 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:01.190579 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cd149f12-b40b-4251-9b86-ececdaa6b1c6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.153941 Jan 21 13:53:01.191132 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 450/898] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:01 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:01.783152 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0caa21a3-1867-4978-8e66-5bc9c993cf0e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:01.784084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0caa21a3-1867-4978-8e66-5bc9c993cf0e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:01.790328 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0caa21a3-1867-4978-8e66-5bc9c993cf0e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:01.790772 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0caa21a3-1867-4978-8e66-5bc9c993cf0e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:01.791535 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0caa21a3-1867-4978-8e66-5bc9c993cf0e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:01.791964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0caa21a3-1867-4978-8e66-5bc9c993cf0e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:02.029751 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:02.030366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:02.036699 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:02.037161 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:02.037944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:02.038381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:02.172999 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:02.180327 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8334fcce-3d80-4cc3-a4e2-8f37f31be766 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.154691 Jan 21 13:53:02.180985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 451/899] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:02 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:53:02.208876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:02.209498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:02.216099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:02.216547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:02.217350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:02.217788 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:02.362515 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:02.370098 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:02.372321 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:02.373493 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-02736439-4bc5-4b9c-8cd6-9c666ed3b098 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.168144 Jan 21 13:53:02.374049 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 452/900] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:02 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:03.197353 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:03.197993 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:03.204937 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:03.205390 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:03.206179 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:03.206616 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:03.335934 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:03.343484 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-95471cb2-7f81-4a61-85d2-861e8286e460 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.149736 Jan 21 13:53:03.344274 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 453/901] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:03 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:53:03.391193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:03.391801 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:03.397570 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:03.398025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:03.398799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:03.399239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:03.530924 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:03.538499 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:03.540006 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:03.541192 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3f7d334d-bc52-4585-b8e4-289543dd2401 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.153454 Jan 21 13:53:03.541748 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 454/902] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:03 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:03.847387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0caa21a3-1867-4978-8e66-5bc9c993cf0e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 25980 microversion: 2.1 time: 2.067677 Jan 21 13:53:03.848638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 449/903] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:01 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 25980 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:04.360750 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:04.361495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:04.367774 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:04.368223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:04.369039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:04.369476 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:04.498577 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:04.505794 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a3133b89-9318-4972-bbe1-7a869eb9b221 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.148671 Jan 21 13:53:04.506356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 455/904] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:04 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:04.560716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:04.561448 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:04.568255 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:04.568736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:04.569518 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:04.570351 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:04.700820 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:04.709119 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:04.710632 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:04.711793 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a60d5a88-d763-4e9f-a3d9-67a4ad518b83 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.155843 Jan 21 13:53:04.712350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 450/905] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:04 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:04.858970 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0007e197-4ff4-4105-87dd-dca687d15f19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:04.859927 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0007e197-4ff4-4105-87dd-dca687d15f19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:04.865957 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0007e197-4ff4-4105-87dd-dca687d15f19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:04.866520 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0007e197-4ff4-4105-87dd-dca687d15f19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:04.867329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0007e197-4ff4-4105-87dd-dca687d15f19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:04.867752 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0007e197-4ff4-4105-87dd-dca687d15f19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:04.961170 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0007e197-4ff4-4105-87dd-dca687d15f19 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 26807 microversion: 2.1 time: 0.106251 Jan 21 13:53:04.962056 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 456/906] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:04 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 26807 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:05.522862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:05.523503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:05.530391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:05.530845 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:05.531627 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:05.532075 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:05.661077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:05.668408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1d741d21-fe79-42ef-862a-c72bdcc27ac8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.149585 Jan 21 13:53:05.669015 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 451/907] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:05 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:05.731618 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:05.732319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:05.739215 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:05.739668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:05.740447 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:05.740924 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:05.873749 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:05.881400 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:05.882911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:05.884067 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-387b0780-1448-42ca-b706-285cf34d5295 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.157363 Jan 21 13:53:05.884670 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 457/908] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:05 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:05.973574 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-59b0474b-5dc4-47fc-9aca-62363e45a321 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:05.974527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-59b0474b-5dc4-47fc-9aca-62363e45a321 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:05.980759 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-59b0474b-5dc4-47fc-9aca-62363e45a321 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:05.981217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-59b0474b-5dc4-47fc-9aca-62363e45a321 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:05.982002 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-59b0474b-5dc4-47fc-9aca-62363e45a321 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:05.982446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-59b0474b-5dc4-47fc-9aca-62363e45a321 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:06.079533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-59b0474b-5dc4-47fc-9aca-62363e45a321 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 27370 microversion: 2.1 time: 0.109452 Jan 21 13:53:06.080361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 452/909] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:05 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 27370 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:06.684639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:06.685267 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:06.691635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:06.692086 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:06.692881 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:06.693321 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:06.825347 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:06.833081 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-58b28e81-5e78-405c-ae60-e68fc9fa9143 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.152277 Jan 21 13:53:06.833672 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 458/910] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:06 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:06.902740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:06.903463 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:06.910392 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:06.910844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:06.911621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:06.912090 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:07.043156 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:07.051300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:07.052855 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:07.054014 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-a520351a-1312-4aaa-82a6-ee3a113fcd93 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.155645 Jan 21 13:53:07.054575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 453/911] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:06 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:07.090050 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e29f4655-742f-49a1-9eac-08654af5e389 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:07.090968 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e29f4655-742f-49a1-9eac-08654af5e389 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:07.097303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e29f4655-742f-49a1-9eac-08654af5e389 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:07.097761 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e29f4655-742f-49a1-9eac-08654af5e389 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:07.098544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e29f4655-742f-49a1-9eac-08654af5e389 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:07.098988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e29f4655-742f-49a1-9eac-08654af5e389 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:07.182827 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e29f4655-742f-49a1-9eac-08654af5e389 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 27737 microversion: 2.1 time: 0.096338 Jan 21 13:53:07.183487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 459/912] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:07 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 27737 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:07.850042 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:07.850698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:07.857040 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:07.857484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:07.858507 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:07.858939 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:07.989092 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:07.996329 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d0117e5d-9893-4fbd-87b6-1fd6ada6866b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.149974 Jan 21 13:53:07.996925 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 454/913] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:07 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:08.073045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:08.073777 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:08.081173 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:08.081629 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:08.082413 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:08.082854 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:08.195387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8af4f03f-611e-4324-9a79-c99bf796e521 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:08.196327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8af4f03f-611e-4324-9a79-c99bf796e521 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:08.203204 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af4f03f-611e-4324-9a79-c99bf796e521 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:08.203650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af4f03f-611e-4324-9a79-c99bf796e521 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:08.204432 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af4f03f-611e-4324-9a79-c99bf796e521 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:08.204903 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8af4f03f-611e-4324-9a79-c99bf796e521 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:08.210168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:08.219027 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:08.220542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:08.221725 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4404679e-896e-4173-917e-75287ae971a9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.152782 Jan 21 13:53:08.222285 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 460/914] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:08 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:08.275409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:08.275901 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:08.282593 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:08.283039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:08.283817 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:08.284253 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:08.294331 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8af4f03f-611e-4324-9a79-c99bf796e521 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28118 microversion: 2.1 time: 0.102542 Jan 21 13:53:08.295208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 455/915] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:08 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28118 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:08.358860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lazy-loading 'services' on Instance uuid 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:53:08.427456 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-956baf3f-fa95-4426-8118-fff9e2ffe41b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb/os-volume_attachments/09a76505-a8ad-4ba9-b699-538c75032f66" status: 202 len: 0 microversion: 2.1 time: 0.155464 Jan 21 13:53:08.428047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 461/916] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:53:08 2022] DELETE /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb/os-volume_attachments/09a76505-a8ad-4ba9-b699-538c75032f66 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 13:53:09.014774 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:09.015561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:09.022634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.023092 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.023883 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.024326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.165750 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:09.173109 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6819d4a2-bdb4-4ec6-9637-75871e6ef427 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.163318 Jan 21 13:53:09.173684 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 456/917] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:09 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:09.239576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:09.240645 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:09.247213 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.247695 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.249216 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.249667 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.306215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b119abc2-1363-4dfb-9d04-12e4663424c4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:09.307258 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b119abc2-1363-4dfb-9d04-12e4663424c4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:09.314758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b119abc2-1363-4dfb-9d04-12e4663424c4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.315307 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b119abc2-1363-4dfb-9d04-12e4663424c4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.316202 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b119abc2-1363-4dfb-9d04-12e4663424c4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.316713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b119abc2-1363-4dfb-9d04-12e4663424c4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.384929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:09.393429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:09.394920 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:09.396053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3e34cf65-6e9b-4120-ac80-061b99aefe14 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.160521 Jan 21 13:53:09.396625 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 462/918] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:09 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:09.403318 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b119abc2-1363-4dfb-9d04-12e4663424c4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28160 microversion: 2.1 time: 0.100712 Jan 21 13:53:09.405081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 457/919] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:09 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28160 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:09.531889 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:09.532394 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:09.538286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.538746 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.539529 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.539970 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.564388 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:53:09.643652 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-571a6024-ce84-4592-b4ad-aeb33dd27e5a tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 204 len: 0 microversion: 2.1 time: 0.115165 Jan 21 13:53:09.644296 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 463/920] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:53:09 2022] DELETE /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:53:09.653194 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:09.653893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:09.662061 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.662519 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.663316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:09.663742 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:09.799495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:09.806967 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-dc160654-cd4e-47d6-bba5-5625fd32a369 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1514 microversion: 2.1 time: 0.158074 Jan 21 13:53:09.807542 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 458/921] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:09 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:10.191140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:10.191838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:10.198033 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.198480 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.199260 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.199697 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.329975 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:10.338444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-482ec4d5-cd5b-45e2-baf2-e1c9505666b6 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.151333 Jan 21 13:53:10.339009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 464/922] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:10 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:10.415051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-837d07c6-437a-48f7-9f29-87b5b00cc8b4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:10.415267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:10.415806 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:10.416035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-837d07c6-437a-48f7-9f29-87b5b00cc8b4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:10.422015 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-837d07c6-437a-48f7-9f29-87b5b00cc8b4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.422312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.422456 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-837d07c6-437a-48f7-9f29-87b5b00cc8b4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.422759 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.423233 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-837d07c6-437a-48f7-9f29-87b5b00cc8b4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.423525 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.423674 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-837d07c6-437a-48f7-9f29-87b5b00cc8b4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.423957 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.492653 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-837d07c6-437a-48f7-9f29-87b5b00cc8b4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28160 microversion: 2.1 time: 0.080916 Jan 21 13:53:10.494134 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 465/923] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:10 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28160 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:10.554284 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:10.562405 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:10.563894 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:10.565064 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6df4e643-1338-4068-a93d-2ddcfa67fa77 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.153784 Jan 21 13:53:10.565615 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 459/924] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:10 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:10.825090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:10.825709 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:10.833616 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.834071 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.834842 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:10.835281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:10.968680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:10.975902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a16c2dae-2de4-4c6f-ba0d-b3e48276b77b tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1514 microversion: 2.1 time: 0.155047 Jan 21 13:53:10.976455 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 466/925] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:10 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:11.355999 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:11.356645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:11.363485 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:11.363939 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:11.364755 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:11.365200 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:11.503161 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:11.503740 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-22e41cfb-c532-4a52-bc9b-d19f9c4c7f45 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:11.504517 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-22e41cfb-c532-4a52-bc9b-d19f9c4c7f45 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:11.510585 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5a41bfbe-056e-4844-87f1-033b524fb26f tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.158288 Jan 21 13:53:11.510776 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22e41cfb-c532-4a52-bc9b-d19f9c4c7f45 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:11.511230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22e41cfb-c532-4a52-bc9b-d19f9c4c7f45 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:11.511339 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 460/926] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:11 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:11.512020 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22e41cfb-c532-4a52-bc9b-d19f9c4c7f45 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:11.512465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22e41cfb-c532-4a52-bc9b-d19f9c4c7f45 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:11.583586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:11.584199 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:11.592044 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:11.592508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:11.593312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:11.593755 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:11.602584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-22e41cfb-c532-4a52-bc9b-d19f9c4c7f45 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28450 microversion: 2.1 time: 0.102550 Jan 21 13:53:11.606467 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 467/927] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:11 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28450 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:11.725805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:11.734099 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:11.735705 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:11.736988 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-00590a6f-9338-4b7a-8e2e-05b664200ad9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.157027 Jan 21 13:53:11.737649 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 461/928] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:11 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:11.994238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:11.994853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:12.002795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.003267 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.004035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.004461 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.080658 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b117cac4191e4366872cd1d1cee4087c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f557e160058a4541b3abde466bd06c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:12.089454 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7e2ccc72-daad-4025-bdcd-935a694c17c2 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 200 len: 1472 microversion: 2.1 time: 0.099212 Jan 21 13:53:12.090290 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 468/929] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:11 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 1472 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:12.122610 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-538fc0bd-b34d-4be3-ac9b-732df9344e9e req-26ed1b9a-cd16-400f-b291-c735a0f3358c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a3664-f9a3-4171-ae3c-3fc6b50183fb", "name": "network-vif-deleted", "tag": "70597764-bc7e-41c2-b76d-a135aaa88df6"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:12.124373 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:53:12.124373 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:53:12.131957 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-538fc0bd-b34d-4be3-ac9b-732df9344e9e req-26ed1b9a-cd16-400f-b291-c735a0f3358c service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.132408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-538fc0bd-b34d-4be3-ac9b-732df9344e9e req-26ed1b9a-cd16-400f-b291-c735a0f3358c service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.144240 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-538fc0bd-b34d-4be3-ac9b-732df9344e9e req-26ed1b9a-cd16-400f-b291-c735a0f3358c service nova] Creating event network-vif-deleted:70597764-bc7e-41c2-b76d-a135aaa88df6 for instance 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb on hv-cinder-82016 Jan 21 13:53:12.149018 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-538fc0bd-b34d-4be3-ac9b-732df9344e9e req-26ed1b9a-cd16-400f-b291-c735a0f3358c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Jan 21 13:53:12.149619 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 462/930] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:53:12.528047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:12.528837 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:12.536757 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.537214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.538045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.538512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.616521 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e8dd19e3-75f9-45a8-a503-bf07cc8a508d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:12.617867 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e8dd19e3-75f9-45a8-a503-bf07cc8a508d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:12.626936 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8dd19e3-75f9-45a8-a503-bf07cc8a508d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.627389 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8dd19e3-75f9-45a8-a503-bf07cc8a508d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.628182 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8dd19e3-75f9-45a8-a503-bf07cc8a508d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.628641 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e8dd19e3-75f9-45a8-a503-bf07cc8a508d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.727942 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e8dd19e3-75f9-45a8-a503-bf07cc8a508d tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28593 microversion: 2.1 time: 0.117035 Jan 21 13:53:12.728666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 463/931] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:12 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28593 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:12.755845 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:12.756554 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:12.764181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.764668 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.765520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:12.765959 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:12.913523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:12.921930 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:12.923621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:12.924911 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-92f6625e-fbdd-4c81-ab2a-ae96f22f84b5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.173136 Jan 21 13:53:12.929103 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 464/932] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:12 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:12.970436 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:12.977908 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-06efb1ee-7e5a-41f3-b8ee-07f7ab523dfc tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.454297 Jan 21 13:53:12.978476 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 469/933] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:12 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:13.106899 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:13.107521 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] [instance: 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:13.114021 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:13.114474 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:13.115260 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:13.115697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:13.128980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] HTTP exception thrown: Instance 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb could not be found. Jan 21 13:53:13.129564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] Returning 404 to user: Instance 6f8a3664-f9a3-4171-ae3c-3fc6b50183fb could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:53:13.130405 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bfa38523-fd51-4b5b-a56d-67cec63dc3c5 tempest-VolumesSnapshotTestJSON-384922519 tempest-VolumesSnapshotTestJSON-384922519-project] 10.222.0.84 "GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb" status: 404 len: 111 microversion: 2.1 time: 0.027285 Jan 21 13:53:13.130921 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 465/934] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:13 2022] GET /compute/v2.1/servers/6f8a3664-f9a3-4171-ae3c-3fc6b50183fb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:53:13.739423 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cef47836-e3a8-4043-811d-4df5a17ca0c6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:13.740350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cef47836-e3a8-4043-811d-4df5a17ca0c6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:13.746585 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cef47836-e3a8-4043-811d-4df5a17ca0c6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:13.747030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cef47836-e3a8-4043-811d-4df5a17ca0c6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:13.747794 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cef47836-e3a8-4043-811d-4df5a17ca0c6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:13.748783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cef47836-e3a8-4043-811d-4df5a17ca0c6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:13.824565 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cef47836-e3a8-4043-811d-4df5a17ca0c6 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28618 microversion: 2.1 time: 0.088877 Jan 21 13:53:13.825469 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 470/935] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:13 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28618 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:13.943057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:13.943688 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:13.949852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:13.950297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:13.951064 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:13.951652 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:13.995492 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:13.996243 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:14.003873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:14.004406 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:14.005286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:14.005792 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:14.080693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:14.088412 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:14.089946 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:14.091108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f32e45fc-8f3e-4065-912e-d459fda43033 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.151810 Jan 21 13:53:14.091650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 466/936] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:13 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:14.142525 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:14.149771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-69253b83-8049-407a-b594-16da9ac1c1ad tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.158485 Jan 21 13:53:14.150333 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 471/937] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:13 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:53:14.836671 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ed36c219-86dc-4638-984a-b942b7d6941b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:14.837585 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ed36c219-86dc-4638-984a-b942b7d6941b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:14.844722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed36c219-86dc-4638-984a-b942b7d6941b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:14.845206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed36c219-86dc-4638-984a-b942b7d6941b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:14.846024 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed36c219-86dc-4638-984a-b942b7d6941b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:14.846461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed36c219-86dc-4638-984a-b942b7d6941b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:15.109273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:15.109941 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:15.116104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:15.116559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:15.117393 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:15.117835 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:15.250423 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:15.258105 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:15.259603 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:15.260783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5e57e432-340a-4a9e-95ee-928a5e890898 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1743 microversion: 2.20 time: 0.155461 Jan 21 13:53:15.261338 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 472/938] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:15 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:15.266143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:15.266734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:15.272374 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:15.272863 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:15.273644 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:15.274081 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:15.403140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:15.410800 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9aecb50e-a0d5-4649-8186-c38fa7f5089c tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.148538 Jan 21 13:53:15.411362 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 473/939] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:15 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:16.279084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:16.280514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:16.286586 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:16.287038 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:16.287816 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:16.288256 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:16.414500 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:16.422191 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:16.423704 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:16.424877 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6fafb3da-525c-413d-93ee-b894a9633602 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1743 microversion: 2.20 time: 0.149752 Jan 21 13:53:16.425431 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 474/940] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:16 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:16.429563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:16.430165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:16.435732 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:16.436257 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:16.437008 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:16.437449 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:16.578325 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:16.585683 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-58b477bd-3ce7-44fe-8691-8528ef830da4 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.159226 Jan 21 13:53:16.586242 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 475/941] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:16 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:17.443153 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:17.443787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:17.449908 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:17.450352 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:17.451218 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:17.451759 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:17.578853 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:17.586398 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:17.587893 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:17.589060 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c6f787bd-a076-4d74-8fb2-a46b21222715 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1743 microversion: 2.20 time: 0.149685 Jan 21 13:53:17.589608 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 476/942] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:17 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:17.602131 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:17.602736 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:17.609318 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:17.609774 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:17.610581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:17.611025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:17.746170 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:17.753952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5e7c3b64-5ba9-418a-abd5-7548897eb3a8 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.155261 Jan 21 13:53:17.754527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 477/943] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:17 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:53:17.837596 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ed36c219-86dc-4638-984a-b942b7d6941b tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28618 microversion: 2.1 time: 3.004450 Jan 21 13:53:17.838859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 467/944] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:14 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28618 bytes in 3007 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:18.042906 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-a4c2a1cc-3215-414f-9f92-b15408e20f63 req-f1beedb2-e9a8-494c-b94e-45f70dc44e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f409b3-10f8-4920-b146-2587110be8f6", "name": "network-vif-plugged", "status": "completed", "tag": "a19095e3-cf06-48dc-9a39-1af3f2004ebb"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:18.044743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:53:18.044743 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:53:18.052255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a4c2a1cc-3215-414f-9f92-b15408e20f63 req-f1beedb2-e9a8-494c-b94e-45f70dc44e5e service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:18.052877 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a4c2a1cc-3215-414f-9f92-b15408e20f63 req-f1beedb2-e9a8-494c-b94e-45f70dc44e5e service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:18.068782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-a4c2a1cc-3215-414f-9f92-b15408e20f63 req-f1beedb2-e9a8-494c-b94e-45f70dc44e5e service nova] Creating event network-vif-plugged:a19095e3-cf06-48dc-9a39-1af3f2004ebb for instance 09f409b3-10f8-4920-b146-2587110be8f6 on hv-cinder-82016 Jan 21 13:53:18.075335 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-a4c2a1cc-3215-414f-9f92-b15408e20f63 req-f1beedb2-e9a8-494c-b94e-45f70dc44e5e service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036306 Jan 21 13:53:18.077298 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 478/945] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:53:18.608216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:18.609068 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:18.616093 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:18.616584 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:18.617375 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:18.617833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:18.762376 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:18.771189 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:18.772094 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:18.772860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:18.773948 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:18.775224 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-30de3bf1-a940-43bb-b23a-8fe459e663fe tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.171584 Jan 21 13:53:18.776153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 468/946] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:18 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:18.781156 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:18.781843 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:18.782847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:18.783276 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:18.850823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8b1ab625-e6c8-49ce-99db-ae64f2687ad8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:18.852691 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8b1ab625-e6c8-49ce-99db-ae64f2687ad8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:18.871123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8b1ab625-e6c8-49ce-99db-ae64f2687ad8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:18.871589 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8b1ab625-e6c8-49ce-99db-ae64f2687ad8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:18.872402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8b1ab625-e6c8-49ce-99db-ae64f2687ad8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:18.873028 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8b1ab625-e6c8-49ce-99db-ae64f2687ad8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:18.962687 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8b1ab625-e6c8-49ce-99db-ae64f2687ad8 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28618 microversion: 2.1 time: 0.115381 Jan 21 13:53:18.964085 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 469/947] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:18 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28618 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:18.976710 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:18.984766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-31c4541a-211d-4aa4-a200-306712b252e1 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.217400 Jan 21 13:53:18.986044 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 479/948] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:18 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:53:19.796304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:19.797518 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:19.804858 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:19.805586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:19.806610 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:19.807252 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:19.956642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:19.966619 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:19.968924 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:19.970725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6df6b59e-9b3a-4fc7-9e6c-821cfb3a6d2b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.179520 Jan 21 13:53:19.972037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 470/949] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:19 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:19.979668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8335c237-e800-4d67-b2ba-24d7591e6869 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:19.980689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8335c237-e800-4d67-b2ba-24d7591e6869 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:19.989140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8335c237-e800-4d67-b2ba-24d7591e6869 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:19.989644 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8335c237-e800-4d67-b2ba-24d7591e6869 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:19.990509 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8335c237-e800-4d67-b2ba-24d7591e6869 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:19.991025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8335c237-e800-4d67-b2ba-24d7591e6869 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:20.006018 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:20.007256 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:20.015099 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:20.015905 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:20.016942 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:20.017673 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:20.074785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8335c237-e800-4d67-b2ba-24d7591e6869 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 28618 microversion: 2.1 time: 0.102551 Jan 21 13:53:20.076380 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 480/950] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:19 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 28618 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:20.195597 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:20.204327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7802080c-5eef-483e-8623-2afb8f74ac82 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.202453 Jan 21 13:53:20.205702 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 471/951] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:20 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:20.990918 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:20.992193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:20.999289 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:20.999733 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.000512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.001019 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.089576 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-aa0d7ff9-a933-4c66-9489-613497629cf0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:21.091236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-aa0d7ff9-a933-4c66-9489-613497629cf0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:21.103799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa0d7ff9-a933-4c66-9489-613497629cf0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.107020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa0d7ff9-a933-4c66-9489-613497629cf0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.108738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa0d7ff9-a933-4c66-9489-613497629cf0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.109630 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-aa0d7ff9-a933-4c66-9489-613497629cf0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.199316 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:21.216248 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:21.218886 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:21.221839 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3308bd6f-5920-4cc2-92b9-bfd4ad43ad96 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.235403 Jan 21 13:53:21.223007 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 481/952] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:20 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:21.229422 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:21.230164 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:21.234624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-aa0d7ff9-a933-4c66-9489-613497629cf0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 29673 microversion: 2.1 time: 0.139676 Jan 21 13:53:21.239234 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 472/953] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:21 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 29673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:21.239446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.239446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.239943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.240486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.398156 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:21.407387 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1eb30a4a-4ae0-441f-9233-95f2cf0cb948 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1508 microversion: 2.1 time: 0.183024 Jan 21 13:53:21.407987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 482/954] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:21 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:21.424548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6dd12189-1bba-4cc9-b290-7748608a5169 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:21.425258 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6dd12189-1bba-4cc9-b290-7748608a5169 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:21.432921 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd12189-1bba-4cc9-b290-7748608a5169 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.433384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd12189-1bba-4cc9-b290-7748608a5169 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.434206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd12189-1bba-4cc9-b290-7748608a5169 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.434660 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6dd12189-1bba-4cc9-b290-7748608a5169 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.533953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6dd12189-1bba-4cc9-b290-7748608a5169 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "POST /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6/action" status: 202 len: 0 microversion: 2.1 time: 0.113533 Jan 21 13:53:21.534592 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 473/955] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:21 2022] POST /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:53:21.592913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:21.593522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:21.603985 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.604441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.605262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:21.605702 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:21.808689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:21.821938 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2e5b1fcc-6ebf-4c98-8019-8192c68a0401 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1516 microversion: 2.1 time: 0.279075 Jan 21 13:53:21.824854 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 483/956] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:21 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:22.241765 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:22.242322 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:22.247729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-16b9e07d-1f4c-4113-9b35-ee9bfb754d39 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:22.249351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-16b9e07d-1f4c-4113-9b35-ee9bfb754d39 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:22.253683 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:22.254142 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:22.254955 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:22.255384 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:22.257605 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b9e07d-1f4c-4113-9b35-ee9bfb754d39 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:22.258286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b9e07d-1f4c-4113-9b35-ee9bfb754d39 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:22.259286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b9e07d-1f4c-4113-9b35-ee9bfb754d39 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:22.259914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b9e07d-1f4c-4113-9b35-ee9bfb754d39 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:22.361546 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-16b9e07d-1f4c-4113-9b35-ee9bfb754d39 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 31305 microversion: 2.1 time: 0.116793 Jan 21 13:53:22.362369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 484/957] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:22 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 31305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:22.409688 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:22.418784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:22.421166 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:22.422409 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2f80fa50-2ba9-4b2b-8d2f-2e3e83a8c0ac tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.185242 Jan 21 13:53:22.423032 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 474/958] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:22 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:22.841930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:22.843014 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:22.850263 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:22.851059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:22.852088 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:22.853020 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:23.083646 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:23.093060 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-36952a0d-5e99-4145-92be-2eb6b6a49823 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.255316 Jan 21 13:53:23.093999 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 485/959] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:22 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:23.377240 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bb95d1ce-829d-4165-b228-58e27d749917 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:23.378794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bb95d1ce-829d-4165-b228-58e27d749917 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:23.384885 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bb95d1ce-829d-4165-b228-58e27d749917 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:23.385545 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bb95d1ce-829d-4165-b228-58e27d749917 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:23.386327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bb95d1ce-829d-4165-b228-58e27d749917 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:23.386776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bb95d1ce-829d-4165-b228-58e27d749917 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:23.440983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:23.442273 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:23.448885 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:23.449340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:23.450149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:23.450799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:23.596451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:23.605509 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:23.607183 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:23.608601 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d1967bd5-925a-4e1a-9312-332ab368976e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.171332 Jan 21 13:53:23.609418 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 486/960] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:23 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:24.110933 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:24.111799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:24.119162 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:24.119673 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:24.120538 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:24.121084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:24.270043 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:24.278132 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-553d00de-463d-42ac-ba75-7ca5984c690d tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.170898 Jan 21 13:53:24.280091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 487/961] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:24 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:53:24.475280 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-3a8179c4-89e1-40bf-b061-85daa00f47ca req-e51568a2-e356-4c8c-b6bf-c2796e13b5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591899e6-cf08-42d3-9b97-59bfd88f7fa6", "name": "network-vif-unplugged", "status": "completed", "tag": "40372efa-3a9e-443e-a378-7289829a045d"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:24.476845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:53:24.476845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:53:24.484854 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-3a8179c4-89e1-40bf-b061-85daa00f47ca req-e51568a2-e356-4c8c-b6bf-c2796e13b5c3 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:24.485515 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-3a8179c4-89e1-40bf-b061-85daa00f47ca req-e51568a2-e356-4c8c-b6bf-c2796e13b5c3 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:24.496862 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-3a8179c4-89e1-40bf-b061-85daa00f47ca req-e51568a2-e356-4c8c-b6bf-c2796e13b5c3 service nova] Creating event network-vif-unplugged:40372efa-3a9e-443e-a378-7289829a045d for instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 on hv-cinder-82016 Jan 21 13:53:24.503063 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-3a8179c4-89e1-40bf-b061-85daa00f47ca req-e51568a2-e356-4c8c-b6bf-c2796e13b5c3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031354 Jan 21 13:53:24.503863 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 488/962] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:53:24.630397 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:24.631639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:24.639455 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:24.639929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:24.640814 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:24.641247 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:24.789560 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:24.798024 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:24.799552 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:24.800799 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5b262329-ac62-4f3a-89ab-3ace1cf92806 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.176163 Jan 21 13:53:24.801551 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 489/963] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:24 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:25.296104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:25.297224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:25.306101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:25.306558 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:25.307521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:25.307976 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:25.459381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:25.467505 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-dd9de6a4-4614-43e7-a30f-43cadf0f1705 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.175939 Jan 21 13:53:25.468087 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 490/964] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:25 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:53:25.819532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:25.820221 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:25.827389 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:25.827972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:25.828896 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:25.829470 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:25.975482 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:25.985063 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:25.986591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:25.987898 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ca0c2cf9-9b6e-44a8-aac8-47d35c20fbc1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.172445 Jan 21 13:53:25.988466 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 491/965] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:25 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:26.311277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bb95d1ce-829d-4165-b228-58e27d749917 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 35080 microversion: 2.1 time: 2.938987 Jan 21 13:53:26.312220 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 475/966] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:23 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 35080 bytes in 2941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:26.485436 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:26.486051 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:26.494868 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:26.495332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:26.496141 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:26.496582 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:26.765894 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:26.775477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9184a981-5ae9-4485-b3f3-6e897566afa0 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.294752 Jan 21 13:53:26.776364 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 492/967] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:26 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:27.009755 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:27.010594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:27.022786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:27.022786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:27.023620 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:27.024876 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:27.186866 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:27.195460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:27.197059 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:27.198321 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-461e76dd-6b3c-4818-b6e4-b6ca08e94b1b tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.195232 Jan 21 13:53:27.198903 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 476/968] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:27 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:27.323645 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a2e9bf60-4d25-42ad-ad90-99280d147273 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:27.325541 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a2e9bf60-4d25-42ad-ad90-99280d147273 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:27.332526 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2e9bf60-4d25-42ad-ad90-99280d147273 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:27.333238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2e9bf60-4d25-42ad-ad90-99280d147273 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:27.334277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2e9bf60-4d25-42ad-ad90-99280d147273 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:27.334723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2e9bf60-4d25-42ad-ad90-99280d147273 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:27.413800 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a2e9bf60-4d25-42ad-ad90-99280d147273 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 35725 microversion: 2.1 time: 0.093566 Jan 21 13:53:27.418068 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 493/969] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:27 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 35725 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:27.793958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:27.795353 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:27.801891 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:27.802638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:27.803138 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:27.803575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:27.955465 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:27.964211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b0a66731-4fa6-49f4-a353-a53f8b26192b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.173823 Jan 21 13:53:27.965168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 477/970] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:27 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:28.219053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:28.219744 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:28.226563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:28.227010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:28.227804 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:28.228223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:28.356401 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:28.364964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:28.366457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:28.367635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b1ae96e-cdae-45ba-92d2-1dd3192847e6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1738 microversion: 2.20 time: 0.152801 Jan 21 13:53:28.368187 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 494/971] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:28 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:28.425390 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0a5b0d00-ad82-4ff7-9964-69ae8201c97f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:28.426330 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0a5b0d00-ad82-4ff7-9964-69ae8201c97f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:28.432449 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0a5b0d00-ad82-4ff7-9964-69ae8201c97f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:28.432929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0a5b0d00-ad82-4ff7-9964-69ae8201c97f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:28.433691 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0a5b0d00-ad82-4ff7-9964-69ae8201c97f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:28.434123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0a5b0d00-ad82-4ff7-9964-69ae8201c97f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:28.518618 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0a5b0d00-ad82-4ff7-9964-69ae8201c97f tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 36922 microversion: 2.1 time: 0.096598 Jan 21 13:53:28.520157 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 478/972] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:28 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 36922 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:28.982854 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:28.983463 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:28.989741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:28.990197 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:28.990987 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:28.991425 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:29.209551 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:29.218653 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-33a4e1dd-ec55-4df7-abef-b56e1f32931b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.239806 Jan 21 13:53:29.219231 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 495/973] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:28 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:29.386969 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:29.387673 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:29.395318 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:29.395774 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:29.396557 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:29.397024 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:29.523233 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:29.530690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-106fc3ab-3e27-4fcc-bd65-7dca7f02cd8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:29.531588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-106fc3ab-3e27-4fcc-bd65-7dca7f02cd8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:29.532148 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:29.533686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:29.534852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6a49ffde-a9aa-49f7-8a0b-d9e2065808d1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1720 microversion: 2.20 time: 0.151991 Jan 21 13:53:29.535440 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 479/974] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:29 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:29.537736 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-106fc3ab-3e27-4fcc-bd65-7dca7f02cd8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:29.538183 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-106fc3ab-3e27-4fcc-bd65-7dca7f02cd8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:29.538955 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-106fc3ab-3e27-4fcc-bd65-7dca7f02cd8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:29.539385 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-106fc3ab-3e27-4fcc-bd65-7dca7f02cd8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:29.766171 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-106fc3ab-3e27-4fcc-bd65-7dca7f02cd8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 38148 microversion: 2.1 time: 0.239123 Jan 21 13:53:29.767091 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 496/975] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:29 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 38148 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:30.235478 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:30.236100 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:30.242438 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:30.242890 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:30.243768 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:30.244215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:30.376520 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:30.383830 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-251b8cf9-86ca-4c34-8d0d-1ad034456cae tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.152150 Jan 21 13:53:30.384404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 480/976] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:30 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:30.553417 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:30.554042 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:30.561445 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:30.561892 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:30.562661 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:30.563092 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:30.696044 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:30.703870 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:30.705413 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:30.706550 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0dc83d27-884f-49a3-8fe3-6be7c877786a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1720 microversion: 2.20 time: 0.157191 Jan 21 13:53:30.707090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 497/977] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:30 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:30.778147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-80836ccc-ec27-4cbd-8d9b-2acc78f4357e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:30.779740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-80836ccc-ec27-4cbd-8d9b-2acc78f4357e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:30.785891 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80836ccc-ec27-4cbd-8d9b-2acc78f4357e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:30.786333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80836ccc-ec27-4cbd-8d9b-2acc78f4357e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:30.787105 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80836ccc-ec27-4cbd-8d9b-2acc78f4357e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:30.787536 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-80836ccc-ec27-4cbd-8d9b-2acc78f4357e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:30.849562 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-80836ccc-ec27-4cbd-8d9b-2acc78f4357e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 38148 microversion: 2.1 time: 0.075139 Jan 21 13:53:30.850108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 481/978] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:30 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 38148 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:31.401867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:31.402482 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:31.410038 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.410628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.411671 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.412181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.541375 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:31.548785 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-afa02016-d712-4cdd-b806-430cb4183473 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.150873 Jan 21 13:53:31.549349 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 498/979] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:31 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:31.724841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:31.725541 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:31.732422 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.732901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.733683 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.734125 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.864313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:31.866931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d78e2938-4afb-422f-9097-3a11706d2109 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:31.867847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d78e2938-4afb-422f-9097-3a11706d2109 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:31.873235 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:31.874830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d78e2938-4afb-422f-9097-3a11706d2109 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.874972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:31.875281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d78e2938-4afb-422f-9097-3a11706d2109 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.876061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d78e2938-4afb-422f-9097-3a11706d2109 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.876233 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b3c23328-c4d5-4786-bc38-369ee2c809a7 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1663 microversion: 2.20 time: 0.155473 Jan 21 13:53:31.876495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d78e2938-4afb-422f-9097-3a11706d2109 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.876944 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 482/980] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:31 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:31.894129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d8b80f73-e46b-4c18-9232-f8848e1e63f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db075cbc-4220-47e4-b966-7ecd75be6b36"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:31.895168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d8b80f73-e46b-4c18-9232-f8848e1e63f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:31.900815 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d8b80f73-e46b-4c18-9232-f8848e1e63f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.901270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d8b80f73-e46b-4c18-9232-f8848e1e63f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.902305 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d8b80f73-e46b-4c18-9232-f8848e1e63f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:31.902739 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d8b80f73-e46b-4c18-9232-f8848e1e63f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:31.953392 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d78e2938-4afb-422f-9097-3a11706d2109 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 38148 microversion: 2.1 time: 0.089782 Jan 21 13:53:31.955495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 499/981] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:31 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 38148 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:32.055499 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-4f010aef-1af0-4c05-bf91-117e63803653 req-5700c6d9-64d8-45b3-8221-56b842a17f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f409b3-10f8-4920-b146-2587110be8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "a19095e3-cf06-48dc-9a39-1af3f2004ebb"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:32.058267 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:53:32.058267 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:53:32.069053 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-4f010aef-1af0-4c05-bf91-117e63803653 req-5700c6d9-64d8-45b3-8221-56b842a17f6b service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.069727 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-4f010aef-1af0-4c05-bf91-117e63803653 req-5700c6d9-64d8-45b3-8221-56b842a17f6b service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.085428 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.compute.server_external_events [req-4f010aef-1af0-4c05-bf91-117e63803653 req-5700c6d9-64d8-45b3-8221-56b842a17f6b service nova] Unable to find a host for instance 09f409b3-10f8-4920-b146-2587110be8f6. Dropping event network-vif-unplugged {{(pid=122814) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 21 13:53:32.086572 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-4f010aef-1af0-4c05-bf91-117e63803653 req-5700c6d9-64d8-45b3-8221-56b842a17f6b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036494 Jan 21 13:53:32.087656 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 500/982] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 21 13:53:32.198826 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d8b80f73-e46b-4c18-9232-f8848e1e63f5 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308321 Jan 21 13:53:32.199432 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 483/983] 10.222.0.84 () {62 vars in 1363 bytes} [Fri Jan 21 13:53:31 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 13:53:32.311066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-194f81d6-9805-4b41-a90a-132a7290b169 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:32.311685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-194f81d6-9805-4b41-a90a-132a7290b169 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:32.318125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-194f81d6-9805-4b41-a90a-132a7290b169 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.318518 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-194f81d6-9805-4b41-a90a-132a7290b169 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.319301 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-194f81d6-9805-4b41-a90a-132a7290b169 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.320013 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-194f81d6-9805-4b41-a90a-132a7290b169 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.528432 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-194f81d6-9805-4b41-a90a-132a7290b169 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-volume_attachments/db075cbc-4220-47e4-b966-7ecd75be6b36" status: 202 len: 0 microversion: 2.20 time: 0.222490 Jan 21 13:53:32.529074 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 501/984] 10.222.0.84 () {60 vars in 1456 bytes} [Fri Jan 21 13:53:32 2022] DELETE /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-volume_attachments/db075cbc-4220-47e4-b966-7ecd75be6b36 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:53:32.567120 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:32.567740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:32.574009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.574402 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.575179 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.576780 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.581269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0fc0f18a-166d-4a5d-8d05-9f06022187c8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:32.581846 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0fc0f18a-166d-4a5d-8d05-9f06022187c8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:32.588021 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fc0f18a-166d-4a5d-8d05-9f06022187c8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.588473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fc0f18a-166d-4a5d-8d05-9f06022187c8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.589314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fc0f18a-166d-4a5d-8d05-9f06022187c8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.589766 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fc0f18a-166d-4a5d-8d05-9f06022187c8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.683984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0fc0f18a-166d-4a5d-8d05-9f06022187c8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action" status: 202 len: 0 microversion: 2.20 time: 0.106447 Jan 21 13:53:32.685328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 502/985] 10.222.0.84 () {62 vars in 1318 bytes} [Fri Jan 21 13:53:32 2022] POST /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 21 13:53:32.693377 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:32.694262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:32.700429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.700929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.701819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.702261 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.720456 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:32.729414 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9de4b902-a8a6-483e-878b-055d2fea9b55 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.166123 Jan 21 13:53:32.740046 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 484/986] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:32 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:32.852768 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:32.861663 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:32.863180 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:32.864349 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3ba23fa1-6884-4070-81dc-596226f47ce2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1671 microversion: 2.20 time: 0.174744 Jan 21 13:53:32.864933 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 503/987] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:32 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:32.965403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5e7004d7-1de7-4b78-bbc4-2077c09d9a8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:32.967319 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5e7004d7-1de7-4b78-bbc4-2077c09d9a8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:32.973293 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e7004d7-1de7-4b78-bbc4-2077c09d9a8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.974045 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e7004d7-1de7-4b78-bbc4-2077c09d9a8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:32.975013 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e7004d7-1de7-4b78-bbc4-2077c09d9a8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:32.975470 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5e7004d7-1de7-4b78-bbc4-2077c09d9a8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:33.054690 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5e7004d7-1de7-4b78-bbc4-2077c09d9a8e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action" status: 200 len: 38279 microversion: 2.1 time: 0.092620 Jan 21 13:53:33.055333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 485/988] 10.222.0.84 () {60 vars in 1277 bytes} [Fri Jan 21 13:53:32 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/action => generated 38279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 13:53:33.066326 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c5db7442-09fc-43a9-aab4-36fcc600f40c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:33.066820 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c5db7442-09fc-43a9-aab4-36fcc600f40c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:33.073018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5db7442-09fc-43a9-aab4-36fcc600f40c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:33.073459 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5db7442-09fc-43a9-aab4-36fcc600f40c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:33.074241 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5db7442-09fc-43a9-aab4-36fcc600f40c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:33.074668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5db7442-09fc-43a9-aab4-36fcc600f40c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:33.099690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c5db7442-09fc-43a9-aab4-36fcc600f40c tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/ips" status: 200 len: 145 microversion: 2.1 time: 0.036931 Jan 21 13:53:33.100306 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 504/989] 10.222.0.84 () {58 vars in 1247 bytes} [Fri Jan 21 13:53:33 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:53:33.747766 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:33.748497 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:33.755056 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:33.755507 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:33.756327 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:33.756786 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:33.883231 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:33.883873 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:33.888872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:33.890860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:33.891314 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:33.892290 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:33.892763 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:33.896761 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c1edf504-219f-41df-b26a-b7bfd4fa54a9 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1574 microversion: 2.1 time: 0.153183 Jan 21 13:53:33.897337 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 486/990] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:33 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:34.053591 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:34.063167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:34.064703 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:34.065874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4dfc42f5-6427-493b-8ffa-f2e6c9a42ea2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.186509 Jan 21 13:53:34.066436 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 505/991] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:33 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:34.458642 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e6bd9e1f-58a4-480b-bbc5-f972992fddb0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d9a2f6-5f2e-4d6b-94c6-18e55023ec56"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:34.459921 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e6bd9e1f-58a4-480b-bbc5-f972992fddb0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:34.467846 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6bd9e1f-58a4-480b-bbc5-f972992fddb0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:34.468878 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6bd9e1f-58a4-480b-bbc5-f972992fddb0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:34.469287 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6bd9e1f-58a4-480b-bbc5-f972992fddb0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:34.469799 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e6bd9e1f-58a4-480b-bbc5-f972992fddb0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:34.708487 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e6bd9e1f-58a4-480b-bbc5-f972992fddb0 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254344 Jan 21 13:53:34.709129 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 487/992] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:53:34 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:53:34.913782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:34.914388 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:34.921623 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:34.922099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:34.922917 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:34.923295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:35.085734 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:35.086838 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:35.098544 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:35.099398 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:35.102671 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:35.104347 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:35.164583 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:35.174888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1d51fd87-e42f-447c-8db1-a5d82d4a9282 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1561 microversion: 2.1 time: 0.264256 Jan 21 13:53:35.175572 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 506/993] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:53:34 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1561 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:53:35.310289 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:35.319431 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:35.320964 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:35.322645 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-65eaca10-5fba-4a44-9763-07236d883d50 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.241633 Jan 21 13:53:35.323208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 488/994] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:35 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:36.343542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:36.344147 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:36.350967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:36.351681 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:36.352492 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:36.352960 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:36.504072 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:36.512492 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:36.514321 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:36.519639 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-183e2f51-49c3-4756-a89d-8db844f62b17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.180214 Jan 21 13:53:36.520699 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 507/995] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:36 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:37.539211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:37.540103 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:37.547720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:37.548411 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:37.550061 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:37.550604 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:37.753118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:37.763550 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:37.765656 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:37.767037 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-90d42106-58d6-4e76-9e6a-81dc5b0eca2c tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.232077 Jan 21 13:53:37.768228 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 489/996] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:37 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:38.306307 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-049acc6e-cd60-4a53-9a9d-f1640a81afc9 req-5391d74b-7ba2-42d3-b2a0-33ddd5faabdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591899e6-cf08-42d3-9b97-59bfd88f7fa6", "name": "network-vif-plugged", "status": "completed", "tag": "40372efa-3a9e-443e-a378-7289829a045d"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:38.308966 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:53:38.308966 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:53:38.322028 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-049acc6e-cd60-4a53-9a9d-f1640a81afc9 req-5391d74b-7ba2-42d3-b2a0-33ddd5faabdf service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:38.322913 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-049acc6e-cd60-4a53-9a9d-f1640a81afc9 req-5391d74b-7ba2-42d3-b2a0-33ddd5faabdf service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:38.340556 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-049acc6e-cd60-4a53-9a9d-f1640a81afc9 req-5391d74b-7ba2-42d3-b2a0-33ddd5faabdf service nova] Creating event network-vif-plugged:40372efa-3a9e-443e-a378-7289829a045d for instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 on hv-cinder-82016 Jan 21 13:53:38.347013 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-049acc6e-cd60-4a53-9a9d-f1640a81afc9 req-5391d74b-7ba2-42d3-b2a0-33ddd5faabdf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044614 Jan 21 13:53:38.347997 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 508/997] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:53:38.786244 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:38.786853 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:38.793079 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:38.793527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:38.795460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:38.795904 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:38.950275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:38.959393 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:38.960812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:38.961974 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0f447973-6882-4633-9b6a-70f4e995f7e9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.179482 Jan 21 13:53:38.962529 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 490/998] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:38 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:39.980660 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:39.981865 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:39.988277 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:39.988772 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:39.989544 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:39.989980 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:40.132278 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:40.141351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:40.142845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:40.143990 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1210ba60-d19e-47af-b97c-e0ea442098f8 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.167396 Jan 21 13:53:40.144542 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 509/999] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:39 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:41.162340 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:41.162927 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:41.169236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:41.169662 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:41.170434 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:41.170865 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:41.323893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:41.334484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:41.336250 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:41.337445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8da665be-7851-4cc0-99d2-932b9e8a9ef6 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.178828 Jan 21 13:53:41.338126 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 491/1000] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:41 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:42.358928 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:42.359628 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:42.366839 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:42.367293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:42.368081 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:42.368520 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:42.531047 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:42.538919 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:42.540405 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:42.541582 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1d6a3716-ba7d-4949-a507-8ab921ebf85e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.187809 Jan 21 13:53:42.542136 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 510/1001] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:42 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:43.559678 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:43.560254 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:43.566664 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:43.567116 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:43.567893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:43.568333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:43.707233 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:43.716159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:43.718106 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:43.719590 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-3a442085-1eee-415d-be4b-0bb41cdd1060 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.164205 Jan 21 13:53:43.730685 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 492/1002] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:43 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:44.737751 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:44.738356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:44.744836 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:44.745293 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:44.746078 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:44.746518 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:44.877938 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:44.886214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:44.888366 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:44.889726 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-918787b8-2655-40e8-875e-af3b0f140c17 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.155675 Jan 21 13:53:44.890285 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 511/1003] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:44 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:45.908675 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:45.909291 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:45.915523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:45.915974 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:45.916776 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:45.917215 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:46.049294 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:46.056917 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:46.058408 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:46.059629 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c05bd5f4-8247-40b9-8c73-a789fd380f92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.154685 Jan 21 13:53:46.060186 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 493/1004] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:45 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:47.077869 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:47.078481 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:47.084821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:47.085276 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:47.086059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:47.086500 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:47.216563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:47.224223 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:47.225764 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:47.226910 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fca54344-a5bc-477f-9045-2d6d0b509fcd tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.152892 Jan 21 13:53:47.227463 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 512/1005] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:47 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:48.245704 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:48.246348 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:48.253361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:48.253784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:48.254567 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:48.255007 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:48.384951 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:48.393171 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:48.394684 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:48.395844 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-be68e925-a7a5-425b-8eb3-122d92529834 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.154032 Jan 21 13:53:48.396400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 494/1006] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:48 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:49.415514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:49.415514 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:49.421863 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:49.422317 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:49.423117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:49.423559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:49.581265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:49.588988 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:49.590498 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:49.591712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-abc3c415-532b-4ec4-96bc-1a64c37aabef tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.181401 Jan 21 13:53:49.592315 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 513/1007] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:49 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:50.175164 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-872ddf23-cd00-41b4-8db2-b517c89e33bd req-31c90051-2965-4218-b4c1-649ef9ebe86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f409b3-10f8-4920-b146-2587110be8f6", "name": "network-vif-plugged", "status": "completed", "tag": "a19095e3-cf06-48dc-9a39-1af3f2004ebb"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:50.176805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:53:50.176805 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:53:50.184808 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-872ddf23-cd00-41b4-8db2-b517c89e33bd req-31c90051-2965-4218-b4c1-649ef9ebe86e service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:50.185936 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-872ddf23-cd00-41b4-8db2-b517c89e33bd req-31c90051-2965-4218-b4c1-649ef9ebe86e service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:50.197886 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-872ddf23-cd00-41b4-8db2-b517c89e33bd req-31c90051-2965-4218-b4c1-649ef9ebe86e service nova] Creating event network-vif-plugged:a19095e3-cf06-48dc-9a39-1af3f2004ebb for instance 09f409b3-10f8-4920-b146-2587110be8f6 on hv-cinder-82016 Jan 21 13:53:50.203076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-872ddf23-cd00-41b4-8db2-b517c89e33bd req-31c90051-2965-4218-b4c1-649ef9ebe86e service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Jan 21 13:53:50.203666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 495/1008] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:53:50.610214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:50.610830 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:50.617077 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:50.617530 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:50.618312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:50.618751 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:50.752426 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:50.760127 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:50.761646 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:50.762795 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-91c045a7-2a66-4189-a6e8-267d91d50e0d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.156969 Jan 21 13:53:50.764578 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 514/1009] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:50 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:53:51.683234 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2eac6716-d5a7-41c6-b03c-b49a88cfab88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:51.684220 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2eac6716-d5a7-41c6-b03c-b49a88cfab88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:51.690263 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2eac6716-d5a7-41c6-b03c-b49a88cfab88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:51.690714 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2eac6716-d5a7-41c6-b03c-b49a88cfab88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:51.691502 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2eac6716-d5a7-41c6-b03c-b49a88cfab88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:51.691935 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2eac6716-d5a7-41c6-b03c-b49a88cfab88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:51.721664 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2eac6716-d5a7-41c6-b03c-b49a88cfab88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Jan 21 13:53:51.722507 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 496/1010] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:53:51 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:53:51.731954 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9ae6f8db-8f93-4411-82f1-de3a7392b1a7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:51.733472 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9ae6f8db-8f93-4411-82f1-de3a7392b1a7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:51.738895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae6f8db-8f93-4411-82f1-de3a7392b1a7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:51.739344 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae6f8db-8f93-4411-82f1-de3a7392b1a7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:51.740125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae6f8db-8f93-4411-82f1-de3a7392b1a7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:51.740562 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae6f8db-8f93-4411-82f1-de3a7392b1a7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:51.771214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9ae6f8db-8f93-4411-82f1-de3a7392b1a7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/f2d9a2f6-5f2e-4d6b-94c6-18e55023ec56" status: 200 len: 194 microversion: 2.1 time: 0.042867 Jan 21 13:53:51.771818 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 515/1011] 10.222.0.84 () {58 vars in 1412 bytes} [Fri Jan 21 13:53:51 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/f2d9a2f6-5f2e-4d6b-94c6-18e55023ec56 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:53:51.781833 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:51.782516 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:51.788917 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:51.789621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:51.790432 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:51.790851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:51.945574 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:51.953593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:51.955276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:51.956583 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d15f938d-48c0-4dc2-891e-721063c02d92 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1729 microversion: 2.20 time: 0.178415 Jan 21 13:53:51.957534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 497/1012] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:51 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:52.975095 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:53:52.975698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:52.981935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:52.982380 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:52.983645 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:52.984232 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:53.103898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ed50ecd0-3bc5-47ab-b5dc-85ddc0bcd9d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61cbd4bf-7e55-4ee6-ada0-7ebac0983ce0"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:53:53.104977 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ed50ecd0-3bc5-47ab-b5dc-85ddc0bcd9d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:53:53.111680 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed50ecd0-3bc5-47ab-b5dc-85ddc0bcd9d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:53.112145 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed50ecd0-3bc5-47ab-b5dc-85ddc0bcd9d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:53.113017 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed50ecd0-3bc5-47ab-b5dc-85ddc0bcd9d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:53:53.113407 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed50ecd0-3bc5-47ab-b5dc-85ddc0bcd9d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:53:53.114464 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:53.125932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:53.127441 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:53:53.128633 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6f874d0c-eea6-45c0-bd9f-1c2d0d194129 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1716 microversion: 2.20 time: 0.157250 Jan 21 13:53:53.129193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 516/1013] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:53:52 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:53:53.343038 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ed50ecd0-3bc5-47ab-b5dc-85ddc0bcd9d9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242640 Jan 21 13:53:53.343662 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 498/1014] 10.222.0.84 () {60 vars in 1322 bytes} [Fri Jan 21 13:53:53 2022] POST /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:54:00.797654 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-51ed904a-c046-4a93-a079-01acc6526e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:00.798574 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-51ed904a-c046-4a93-a079-01acc6526e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:00.804829 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51ed904a-c046-4a93-a079-01acc6526e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:00.805285 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51ed904a-c046-4a93-a079-01acc6526e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:00.806068 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51ed904a-c046-4a93-a079-01acc6526e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:00.806511 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51ed904a-c046-4a93-a079-01acc6526e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:00.836095 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-51ed904a-c046-4a93-a079-01acc6526e76 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042152 Jan 21 13:54:00.836650 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 517/1015] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:54:00 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:54:16.444508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f2e8d0af-8527-43a1-aedf-7a4692669c77 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:16.445133 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f2e8d0af-8527-43a1-aedf-7a4692669c77 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:16.451650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e8d0af-8527-43a1-aedf-7a4692669c77 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:16.452339 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e8d0af-8527-43a1-aedf-7a4692669c77 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:16.453160 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e8d0af-8527-43a1-aedf-7a4692669c77 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:16.453600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f2e8d0af-8527-43a1-aedf-7a4692669c77 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:16.484461 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f2e8d0af-8527-43a1-aedf-7a4692669c77 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/f2d9a2f6-5f2e-4d6b-94c6-18e55023ec56" status: 200 len: 194 microversion: 2.1 time: 0.044681 Jan 21 13:54:16.485055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 499/1016] 10.222.0.84 () {58 vars in 1412 bytes} [Fri Jan 21 13:54:16 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/f2d9a2f6-5f2e-4d6b-94c6-18e55023ec56 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:54:16.494373 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:16.494885 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:16.501317 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:16.501776 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:16.502558 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:16.503001 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:16.580193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lazy-loading 'services' on Instance uuid 406e22ef-2339-49fb-9f7f-3568a327b764 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:54:16.646512 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b6a773f-ae0a-4e83-8f65-896000337f7a tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/f2d9a2f6-5f2e-4d6b-94c6-18e55023ec56" status: 202 len: 0 microversion: 2.1 time: 0.155686 Jan 21 13:54:16.647088 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 518/1017] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:54:16 2022] DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/f2d9a2f6-5f2e-4d6b-94c6-18e55023ec56 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:54:17.755629 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7de7fca5-a5ca-4fb5-8ac7-ebd6eb770f79 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:17.756155 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7de7fca5-a5ca-4fb5-8ac7-ebd6eb770f79 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:17.762451 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7de7fca5-a5ca-4fb5-8ac7-ebd6eb770f79 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:17.762906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7de7fca5-a5ca-4fb5-8ac7-ebd6eb770f79 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:17.764375 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7de7fca5-a5ca-4fb5-8ac7-ebd6eb770f79 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:17.764891 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7de7fca5-a5ca-4fb5-8ac7-ebd6eb770f79 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:17.793587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7de7fca5-a5ca-4fb5-8ac7-ebd6eb770f79 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/61cbd4bf-7e55-4ee6-ada0-7ebac0983ce0" status: 200 len: 194 microversion: 2.1 time: 0.041828 Jan 21 13:54:17.794158 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 500/1018] 10.222.0.84 () {58 vars in 1412 bytes} [Fri Jan 21 13:54:17 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/61cbd4bf-7e55-4ee6-ada0-7ebac0983ce0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:54:17.804503 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:17.805113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:17.811303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:17.811749 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:17.812527 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:17.812989 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:17.894238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lazy-loading 'services' on Instance uuid 406e22ef-2339-49fb-9f7f-3568a327b764 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:54:17.962268 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9bf3f7c6-0a35-441d-8145-59d82f424f37 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/61cbd4bf-7e55-4ee6-ada0-7ebac0983ce0" status: 202 len: 0 microversion: 2.1 time: 0.161987 Jan 21 13:54:17.962991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 519/1019] 10.222.0.84 () {58 vars in 1415 bytes} [Fri Jan 21 13:54:17 2022] DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments/61cbd4bf-7e55-4ee6-ada0-7ebac0983ce0 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:54:19.115059 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-afccc233-3fec-4814-9076-e0e902138b35 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:19.115921 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-afccc233-3fec-4814-9076-e0e902138b35 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:19.122622 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-afccc233-3fec-4814-9076-e0e902138b35 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.123429 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-afccc233-3fec-4814-9076-e0e902138b35 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.123947 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-afccc233-3fec-4814-9076-e0e902138b35 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.124446 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-afccc233-3fec-4814-9076-e0e902138b35 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.152972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-afccc233-3fec-4814-9076-e0e902138b35 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041671 Jan 21 13:54:19.153524 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 501/1020] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:54:19 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:54:19.253362 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4ff20df3-9cfe-4634-bf84-4b0c342ec16e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:19.254712 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4ff20df3-9cfe-4634-bf84-4b0c342ec16e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:19.261690 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ff20df3-9cfe-4634-bf84-4b0c342ec16e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.262137 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ff20df3-9cfe-4634-bf84-4b0c342ec16e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.263769 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ff20df3-9cfe-4634-bf84-4b0c342ec16e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.264453 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ff20df3-9cfe-4634-bf84-4b0c342ec16e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.293077 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4ff20df3-9cfe-4634-bf84-4b0c342ec16e tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043766 Jan 21 13:54:19.293619 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 520/1021] 10.222.0.84 () {58 vars in 1301 bytes} [Fri Jan 21 13:54:19 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 13:54:19.347447 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:19.347946 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:19.353888 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.354341 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.355117 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.355553 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.379893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:54:19.454764 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d7661e62-0625-442d-aef4-d6f1efbbcfe7 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 204 len: 0 microversion: 2.1 time: 0.110478 Jan 21 13:54:19.455475 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 502/1022] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:54:19 2022] DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:54:19.463677 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:19.464289 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:19.471142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.471596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.472369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:19.472844 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:19.602184 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:19.609867 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f228676c-380c-451f-8877-eb3523bc9948 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1672 microversion: 2.1 time: 0.149823 Jan 21 13:54:19.610430 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 521/1023] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:19 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:54:20.627902 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:20.628681 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:20.640919 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:20.641366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:20.642159 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:20.642587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:20.772138 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:20.780300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1fb67eed-3bf7-41eb-9792-5ebe4e2d1e88 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1672 microversion: 2.1 time: 0.156757 Jan 21 13:54:20.780907 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 503/1024] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:20 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:54:21.796664 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:21.797383 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:21.803668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:21.804034 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:21.805024 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:21.805470 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:21.881181 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f49de6688841e2b5aaa7f117278348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b908f3a07442bcbeabe49a50f7f48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:21.889197 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ed125932-135a-4e97-a5d2-822a394268a4 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 200 len: 1605 microversion: 2.1 time: 0.095700 Jan 21 13:54:21.889765 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 522/1025] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:21 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 1605 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:54:22.106836 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-fe47a37f-b783-44d1-90fb-c66e116179a6 req-04d2d547-18d2-4e61-9039-11c11007921d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406e22ef-2339-49fb-9f7f-3568a327b764", "name": "network-vif-deleted", "tag": "3388ca83-ec51-4aee-aede-a4637d3d327d"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:54:22.109194 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:54:22.109194 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:54:22.116684 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-fe47a37f-b783-44d1-90fb-c66e116179a6 req-04d2d547-18d2-4e61-9039-11c11007921d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:22.117422 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-fe47a37f-b783-44d1-90fb-c66e116179a6 req-04d2d547-18d2-4e61-9039-11c11007921d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:22.131134 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-fe47a37f-b783-44d1-90fb-c66e116179a6 req-04d2d547-18d2-4e61-9039-11c11007921d service nova] Creating event network-vif-deleted:3388ca83-ec51-4aee-aede-a4637d3d327d for instance 406e22ef-2339-49fb-9f7f-3568a327b764 on hv-cinder-82016 Jan 21 13:54:22.136232 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-fe47a37f-b783-44d1-90fb-c66e116179a6 req-04d2d547-18d2-4e61-9039-11c11007921d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Jan 21 13:54:22.137200 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 504/1026] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:54:22.907177 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:22.907805 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:22.914382 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:22.914852 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:22.915657 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:22.916095 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:22.930083 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] HTTP exception thrown: Instance 406e22ef-2339-49fb-9f7f-3568a327b764 could not be found. Jan 21 13:54:22.930683 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Returning 404 to user: Instance 406e22ef-2339-49fb-9f7f-3568a327b764 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:22.931519 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d94baad4-f2ed-4a51-9f76-d7802fbe51fe tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 404 len: 111 microversion: 2.1 time: 0.028632 Jan 21 13:54:22.932252 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 523/1027] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:22 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:54:22.941121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6022e33e-8ee9-4868-81e5-1c9e7636ab47 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '.version_select at 0x7f51b6fbcca0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:22.960237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6022e33e-8ee9-4868-81e5-1c9e7636ab47 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138956406" status: 202 len: 0 microversion: 2.1 time: 0.023086 Jan 21 13:54:22.961118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 505/1028] 10.222.0.84 () {58 vars in 1217 bytes} [Fri Jan 21 13:54:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138956406 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:54:25.849132 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:25.849627 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:25.855857 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:25.856305 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:25.857719 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:25.858125 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:25.871536 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] HTTP exception thrown: Instance 406e22ef-2339-49fb-9f7f-3568a327b764 could not be found. Jan 21 13:54:25.872145 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Returning 404 to user: Instance 406e22ef-2339-49fb-9f7f-3568a327b764 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:25.873669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f88f639e-4431-4ddf-95c0-f4a76d7bb656 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 404 len: 111 microversion: 2.1 time: 0.028174 Jan 21 13:54:25.874214 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 524/1029] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:54:25 2022] DELETE /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:54:25.882471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:25.883203 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: 406e22ef-2339-49fb-9f7f-3568a327b764] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:25.889555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:25.890012 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:25.890794 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:25.891236 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:25.904296 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] HTTP exception thrown: Instance 406e22ef-2339-49fb-9f7f-3568a327b764 could not be found. Jan 21 13:54:25.904906 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Returning 404 to user: Instance 406e22ef-2339-49fb-9f7f-3568a327b764 could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:25.905725 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8e227050-2ce2-479e-8403-224e91d6b4c9 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764" status: 404 len: 111 microversion: 2.1 time: 0.027456 Jan 21 13:54:25.906251 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 506/1030] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:25 2022] GET /compute/v2.1/servers/406e22ef-2339-49fb-9f7f-3568a327b764 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:54:26.253848 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e8320b15-a372-4e8e-9050-1ca8e929be0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:26.254753 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e8320b15-a372-4e8e-9050-1ca8e929be0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:26.260474 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8320b15-a372-4e8e-9050-1ca8e929be0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:26.260950 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8320b15-a372-4e8e-9050-1ca8e929be0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:26.261716 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8320b15-a372-4e8e-9050-1ca8e929be0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:26.262149 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8320b15-a372-4e8e-9050-1ca8e929be0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:26.291086 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e8320b15-a372-4e8e-9050-1ca8e929be0a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041022 Jan 21 13:54:26.291621 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 525/1031] 10.222.0.84 () {60 vars in 1342 bytes} [Fri Jan 21 13:54:26 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:54:26.346241 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:26.346841 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:26.352564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:26.353039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:26.353804 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:26.354237 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:26.378148 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:54:26.452062 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-85e4691c-c124-4697-8288-4e33bc7fa7b1 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 204 len: 0 microversion: 2.20 time: 0.108870 Jan 21 13:54:26.452838 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 507/1032] 10.222.0.84 () {60 vars in 1279 bytes} [Fri Jan 21 13:54:26 2022] DELETE /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 21 13:54:26.460984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:26.461581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:26.468434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:26.468919 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:26.469716 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:26.470152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:26.601859 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:26.609733 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:26.611244 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:26.612391 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-13d8750f-b2c3-4c22-a274-65bfe9e6af6d tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.155098 Jan 21 13:54:26.612984 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 526/1033] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:54:26 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:54:27.031071 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:27.031652 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:27.037847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:27.038297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:27.039063 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:27.039496 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:27.052411 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] HTTP exception thrown: Instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc could not be found. Jan 21 13:54:27.053020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Returning 404 to user: Instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:27.053825 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-87ae10d1-20d5-48ee-a722-789e4ffe0962 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 404 len: 111 microversion: 2.1 time: 0.026843 Jan 21 13:54:27.054343 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 508/1034] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:54:27 2022] DELETE /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:54:27.062616 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:27.063238 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] [instance: e59552fe-d2ae-43ad-bf63-f4d6958c05fc] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:27.069547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:27.070005 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:27.070787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:27.071399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:27.084939 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] HTTP exception thrown: Instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc could not be found. Jan 21 13:54:27.085522 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] Returning 404 to user: Instance e59552fe-d2ae-43ad-bf63-f4d6958c05fc could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:27.086327 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-50f81f8a-9226-4cd6-8a26-3b90ef80ce48 tempest-AttachVolumeTestJSON-306023781 tempest-AttachVolumeTestJSON-306023781-project] 10.222.0.84 "GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc" status: 404 len: 111 microversion: 2.1 time: 0.028005 Jan 21 13:54:27.086840 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 527/1035] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:27 2022] GET /compute/v2.1/servers/e59552fe-d2ae-43ad-bf63-f4d6958c05fc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:54:27.631099 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:27.631720 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:27.638572 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:27.639364 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:27.640132 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:27.640594 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:27.795858 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:27.803600 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:27.805151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:27.806312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ac4f45aa-c865-440f-8b56-51eed8156f94 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.179246 Jan 21 13:54:27.818099 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 509/1036] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:54:27 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:54:28.826458 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:28.826981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:28.833262 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:28.833710 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:28.834497 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:28.835013 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:29.171568 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:29.180468 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:29.182138 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:29.183331 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f505bc58-5609-4878-a002-7d3374f8513e tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1722 microversion: 2.20 time: 0.361433 Jan 21 13:54:29.183883 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 528/1037] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:54:28 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 13:54:29.731427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-f42fea10-d1bc-4bae-bd75-9259091a5fd5 req-d4952131-5069-402a-9170-02f0ce1838cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f409b3-10f8-4920-b146-2587110be8f6", "name": "network-vif-deleted", "tag": "a19095e3-cf06-48dc-9a39-1af3f2004ebb"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:54:29.734199 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:54:29.734199 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:54:29.743245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-f42fea10-d1bc-4bae-bd75-9259091a5fd5 req-d4952131-5069-402a-9170-02f0ce1838cc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:29.744045 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-f42fea10-d1bc-4bae-bd75-9259091a5fd5 req-d4952131-5069-402a-9170-02f0ce1838cc service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:29.757800 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-f42fea10-d1bc-4bae-bd75-9259091a5fd5 req-d4952131-5069-402a-9170-02f0ce1838cc service nova] Creating event network-vif-deleted:a19095e3-cf06-48dc-9a39-1af3f2004ebb for instance 09f409b3-10f8-4920-b146-2587110be8f6 on hv-cinder-82016 Jan 21 13:54:29.765494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-f42fea10-d1bc-4bae-bd75-9259091a5fd5 req-d4952131-5069-402a-9170-02f0ce1838cc service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037398 Jan 21 13:54:29.766940 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 510/1038] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:54:30.201936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:30.203374 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:30.218110 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:30.221892 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:30.223017 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:30.223916 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:30.285935 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:30.286660 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:30.287272 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lazy-loading 'fault' on Instance uuid 09f409b3-10f8-4920-b146-2587110be8f6 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:54:30.355029 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:30.369121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:30.370654 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658d59ce11804cd6a1c498bdffffbe18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e7437157cf4651b4c5152ebeee82e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:30.371900 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c32d4f45-5fd3-4eeb-8294-2451f7052d90 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 200 len: 1370 microversion: 2.20 time: 0.173891 Jan 21 13:54:30.372446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 529/1039] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:54:30 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 13:54:31.392210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:31.392885 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:31.398997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:31.399682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:31.400929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:31.401382 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:31.419956 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] HTTP exception thrown: Instance 09f409b3-10f8-4920-b146-2587110be8f6 could not be found. Jan 21 13:54:31.420870 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Returning 404 to user: Instance 09f409b3-10f8-4920-b146-2587110be8f6 could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:31.421734 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-779bfd3e-e537-4ef2-9bed-339653ca7541 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 404 len: 111 microversion: 2.20 time: 0.035131 Jan 21 13:54:31.426268 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 511/1040] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:54:31 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:54:31.434976 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-763b4a76-41fa-44bf-a9ed-087c16e5c2c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '.version_select at 0x7f51b6da1820>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:31.466822 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-763b4a76-41fa-44bf-a9ed-087c16e5c2c2 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742699872" status: 204 len: 0 microversion: 2.20 time: 0.038169 Jan 21 13:54:31.467859 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 530/1041] 10.222.0.84 () {60 vars in 1258 bytes} [Fri Jan 21 13:54:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742699872 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 21 13:54:33.554635 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:33.555330 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:33.562324 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:33.562773 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:33.563558 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:33.563991 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:33.576812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] HTTP exception thrown: Instance 09f409b3-10f8-4920-b146-2587110be8f6 could not be found. Jan 21 13:54:33.577397 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Returning 404 to user: Instance 09f409b3-10f8-4920-b146-2587110be8f6 could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:33.578206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f0cf2828-afa3-4c81-ae14-3814be33ded9 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 404 len: 111 microversion: 2.20 time: 0.027450 Jan 21 13:54:33.578737 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 512/1042] 10.222.0.84 () {60 vars in 1279 bytes} [Fri Jan 21 13:54:33 2022] DELETE /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:54:33.587292 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:33.587906 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 09f409b3-10f8-4920-b146-2587110be8f6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:33.594446 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:33.594896 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:33.595682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:33.596122 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:33.609372 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] HTTP exception thrown: Instance 09f409b3-10f8-4920-b146-2587110be8f6 could not be found. Jan 21 13:54:33.609964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Returning 404 to user: Instance 09f409b3-10f8-4920-b146-2587110be8f6 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:33.610782 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-50c731df-e4ca-4ab7-9da7-e02fe70d940a tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6" status: 404 len: 111 microversion: 2.20 time: 0.027870 Jan 21 13:54:33.611308 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 531/1043] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:54:33 2022] GET /compute/v2.1/servers/09f409b3-10f8-4920-b146-2587110be8f6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:54:34.739125 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:34.739736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:34.746066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:34.746521 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:34.747952 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:34.748395 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:34.761490 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] HTTP exception thrown: Instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade could not be found. Jan 21 13:54:34.762087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Returning 404 to user: Instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:34.763670 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6084128f-0225-4e80-8a74-5a04099ed1fc tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 404 len: 111 microversion: 2.20 time: 0.027522 Jan 21 13:54:34.764217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 513/1044] 10.222.0.84 () {60 vars in 1279 bytes} [Fri Jan 21 13:54:34 2022] DELETE /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:54:34.772074 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:34.772767 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] [instance: 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:34.778952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:34.779602 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:34.780400 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:34.781049 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:34.794329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] HTTP exception thrown: Instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade could not be found. Jan 21 13:54:34.795072 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] Returning 404 to user: Instance 5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:34.795884 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8b3dbd9e-1867-4018-90b8-e1ed0cdb8878 tempest-AttachVolumeShelveTestJSON-104656253 tempest-AttachVolumeShelveTestJSON-104656253-project] 10.222.0.84 "GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade" status: 404 len: 111 microversion: 2.20 time: 0.027445 Jan 21 13:54:34.796424 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 532/1045] 10.222.0.84 () {60 vars in 1276 bytes} [Fri Jan 21 13:54:34 2022] GET /compute/v2.1/servers/5f91aca0-fb73-460d-ad2c-2ba0cf9b5ade => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 13:54:54.951427 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:54.951921 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:54.962205 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:54.962445 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-d3b7265e-8ebe-415a-8212-448d99ac7ff6 req-ac787c6f-f372-4600-9d41-7eaac08a60cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591899e6-cf08-42d3-9b97-59bfd88f7fa6", "tag": "40372efa-3a9e-443e-a378-7289829a045d"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:54:54.962923 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:54.963433 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:54.963867 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:54.965765 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:54:54.965765 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:54:54.984931 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d3b7265e-8ebe-415a-8212-448d99ac7ff6 req-ac787c6f-f372-4600-9d41-7eaac08a60cf service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:54.985726 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d3b7265e-8ebe-415a-8212-448d99ac7ff6 req-ac787c6f-f372-4600-9d41-7eaac08a60cf service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:54.991150 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:54:55.006061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-d3b7265e-8ebe-415a-8212-448d99ac7ff6 req-ac787c6f-f372-4600-9d41-7eaac08a60cf service nova] Creating event network-changed:40372efa-3a9e-443e-a378-7289829a045d for instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 on hv-cinder-82016 Jan 21 13:54:55.017980 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-d3b7265e-8ebe-415a-8212-448d99ac7ff6 req-ac787c6f-f372-4600-9d41-7eaac08a60cf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063485 Jan 21 13:54:55.020723 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 533/1046] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:54:55.103211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-30a5b6b1-e5bb-4812-8bb9-c708d0929ee2 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "DELETE /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 204 len: 0 microversion: 2.1 time: 0.154964 Jan 21 13:54:55.103211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 514/1047] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:54:54 2022] DELETE /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:54:55.114540 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:55.115679 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:55.126061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:55.127048 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:55.128440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:55.129910 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:55.494669 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:55.503225 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-85ba5b70-0974-474d-a194-d31626341f15 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1567 microversion: 2.1 time: 0.393368 Jan 21 13:54:55.516037 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 534/1048] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:55 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1567 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:54:56.525213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:56.526259 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:56.533395 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:56.533847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:56.534634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:56.535066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:56.698864 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:56.709052 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7b291b4f-ca75-4af2-a605-1e96fc53723b tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1449 microversion: 2.1 time: 0.187664 Jan 21 13:54:56.709787 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 515/1049] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:56 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1449 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:54:57.231382 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-ad812fd8-d03c-4713-9b64-9a5303f8edac req-6a908705-cac4-48f2-9f5c-99ab34e810fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591899e6-cf08-42d3-9b97-59bfd88f7fa6", "name": "network-vif-deleted", "tag": "40372efa-3a9e-443e-a378-7289829a045d"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:54:57.233009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:54:57.233009 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:54:57.249607 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ad812fd8-d03c-4713-9b64-9a5303f8edac req-6a908705-cac4-48f2-9f5c-99ab34e810fa service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:57.250121 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ad812fd8-d03c-4713-9b64-9a5303f8edac req-6a908705-cac4-48f2-9f5c-99ab34e810fa service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:57.264724 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-ad812fd8-d03c-4713-9b64-9a5303f8edac req-6a908705-cac4-48f2-9f5c-99ab34e810fa service nova] Creating event network-vif-deleted:40372efa-3a9e-443e-a378-7289829a045d for instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 on hv-cinder-82016 Jan 21 13:54:57.270576 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-ad812fd8-d03c-4713-9b64-9a5303f8edac req-6a908705-cac4-48f2-9f5c-99ab34e810fa service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044089 Jan 21 13:54:57.272030 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 535/1050] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:54:57.726909 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:57.727567 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:57.735214 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:57.735634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:57.736547 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:57.737042 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:57.770586 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:57.771095 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:57.771608 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lazy-loading 'fault' on Instance uuid 591899e6-cf08-42d3-9b97-59bfd88f7fa6 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:54:57.818832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16130424abc7467584acb6f15dbf544d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160416387af942969baffb4cbd2e83bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:54:57.827615 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-120799e6-3689-45b2-b404-f3d2460cac37 tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 200 len: 1224 microversion: 2.1 time: 0.104689 Jan 21 13:54:57.828198 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 516/1051] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:57 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:54:58.844243 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:58.844954 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] [instance: 591899e6-cf08-42d3-9b97-59bfd88f7fa6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:54:58.851005 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:58.851456 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:58.852230 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:54:58.852680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:54:58.867396 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] HTTP exception thrown: Instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 could not be found. Jan 21 13:54:58.867980 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Returning 404 to user: Instance 591899e6-cf08-42d3-9b97-59bfd88f7fa6 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:54:58.868841 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b4f1061c-de0f-4b89-8930-1dbf41a2a75a tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6" status: 404 len: 111 microversion: 2.1 time: 0.028577 Jan 21 13:54:58.869369 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 536/1052] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:54:58 2022] GET /compute/v2.1/servers/591899e6-cf08-42d3-9b97-59bfd88f7fa6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:54:59.028901 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b832fc44-2836-4fc2-ad3b-a7c9eac0605e tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] Calling method '.version_select at 0x7f51b6fc8af0>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:54:59.050498 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b832fc44-2836-4fc2-ad3b-a7c9eac0605e tempest-TestShelveInstance-1458527298 tempest-TestShelveInstance-1458527298-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-286078649" status: 202 len: 0 microversion: 2.1 time: 0.025679 Jan 21 13:54:59.051157 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 517/1053] 10.222.0.84 () {58 vars in 1250 bytes} [Fri Jan 21 13:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-286078649 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 13:55:03.547613 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:03.548349 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:03.560783 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:03.561403 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:03.562309 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:03.562877 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:03.588980 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:55:03.685823 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5b906cbd-1613-4a70-a820-86e79561c172 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "DELETE /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 204 len: 0 microversion: 2.1 time: 0.141475 Jan 21 13:55:03.686503 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 537/1054] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:55:03 2022] DELETE /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:55:03.695718 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:03.696328 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:03.703767 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:03.704115 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:03.704957 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:03.705385 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:03.947528 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:03.955616 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-35b621e2-abb9-40d5-a509-a860b39e9ecc tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1575 microversion: 2.1 time: 0.264072 Jan 21 13:55:03.956484 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 518/1055] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:03 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:04.973942 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:04.975353 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:04.985303 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:04.986045 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:04.987182 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:04.987821 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:05.189653 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:05.203401 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-80d019cc-4b8c-4165-b068-4224ed1f6b27 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1575 microversion: 2.1 time: 0.233743 Jan 21 13:55:05.204641 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 538/1056] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:04 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:06.226962 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:06.229559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:06.251736 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:06.252800 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:06.253967 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:06.254498 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:06.378763 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:06.388395 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-65952593-505f-490a-8cf0-246ef0cb172a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1507 microversion: 2.1 time: 0.167419 Jan 21 13:55:06.389516 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 519/1057] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:06 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:06.708349 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-df60799b-69b4-4e4f-b5d5-9c464b9edd16 req-29737398-5c36-4267-b1f8-08cde15a8404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b269ee40-e090-4ad6-a652-0188bd06fa08", "name": "network-vif-deleted", "tag": "50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:06.709972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:06.709972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:55:06.742887 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-df60799b-69b4-4e4f-b5d5-9c464b9edd16 req-29737398-5c36-4267-b1f8-08cde15a8404 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:06.743630 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-df60799b-69b4-4e4f-b5d5-9c464b9edd16 req-29737398-5c36-4267-b1f8-08cde15a8404 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:06.770505 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-df60799b-69b4-4e4f-b5d5-9c464b9edd16 req-29737398-5c36-4267-b1f8-08cde15a8404 service nova] Creating event network-vif-deleted:50fcaddc-29ed-4942-97cc-0b6cd3fb1bdb for instance b269ee40-e090-4ad6-a652-0188bd06fa08 on hv-cinder-82016 Jan 21 13:55:06.790444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-df60799b-69b4-4e4f-b5d5-9c464b9edd16 req-29737398-5c36-4267-b1f8-08cde15a8404 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085767 Jan 21 13:55:06.802206 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 539/1058] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:55:07.406360 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:07.407006 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:07.414127 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:07.415217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:07.416244 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:07.418813 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:07.460450 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:07.461135 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:07.461755 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lazy-loading 'fault' on Instance uuid b269ee40-e090-4ad6-a652-0188bd06fa08 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:55:07.533687 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:07.546059 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-0b9464f8-cdf8-4bea-a732-ad497cf12c14 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 200 len: 1183 microversion: 2.1 time: 0.143177 Jan 21 13:55:07.547312 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 520/1059] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:07 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 1183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:08.564838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:08.565676 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:08.572971 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:08.574061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:08.574888 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:08.575329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:08.588473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] HTTP exception thrown: Instance b269ee40-e090-4ad6-a652-0188bd06fa08 could not be found. Jan 21 13:55:08.589096 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Returning 404 to user: Instance b269ee40-e090-4ad6-a652-0188bd06fa08 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:55:08.590541 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8216f219-fdb4-45bb-be0a-d3945fda7001 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 404 len: 111 microversion: 2.1 time: 0.030771 Jan 21 13:55:08.591275 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 540/1060] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:08 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:55:08.692787 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-604956136", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-264786425", "security_groups": [{"name": "tempest-secgroup-smoke-2074969604"}], "block_device_mapping_v2": [{"uuid": "dea9bd37-2ea6-4934-ab4b-c8607ead3c1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "885b2ee1-8e97-4170-97ad-c321e8aa6294"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:08.802869 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] validate_networks() for [('885b2ee1-8e97-4170-97ad-c321e8aa6294', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:55:09.198036 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:55:09.198458 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:55:09.199494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:55:09.200039 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:55:09.200453 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:55:09.209054 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:09.209523 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:09.210355 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:09.210791 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:09.227364 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:55:09.232917 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for user 0ae8a49f6ca54b8095d6ac95bd03bee0 and project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:55:09.290966 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:55:09.293247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dea9bd37-2ea6-4934-ab4b-c8607ead3c1c',volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:55:09.427537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9cfec3f8-cfc8-4c86-a840-2d7e52603c62 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734841 Jan 21 13:55:09.427537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 521/1061] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:55:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:55:09.434891 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fc312b69-14b9-4176-bec5-f538f7d94a92 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:09.435749 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fc312b69-14b9-4176-bec5-f538f7d94a92 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:09.491428 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fc312b69-14b9-4176-bec5-f538f7d94a92 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:09.499011 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fc312b69-14b9-4176-bec5-f538f7d94a92 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1093 microversion: 2.1 time: 0.068420 Jan 21 13:55:09.499944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 541/1062] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:09 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:10.517316 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:10.518005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:10.529634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:10.529634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:10.530258 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:10.531436 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:10.902333 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:10.911318 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-32157629-a123-40a2-bdf9-c525abdef63b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1209 microversion: 2.1 time: 0.399497 Jan 21 13:55:10.911894 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 522/1063] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:10 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1209 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:11.929707 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:11.930105 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:11.938905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:11.939682 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:11.940833 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:11.941609 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:12.166408 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:12.174647 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-11218551-525b-4ad3-89b8-e8cce409ff3f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.248754 Jan 21 13:55:12.175714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 542/1064] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:11 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:12.240561 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-4aba13d1-c0ea-4990-bf7d-c0016a0721b1 req-63be826c-6bd0-4ae1-854d-d4840a8f6a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4871177-efda-4482-a209-235647fa3c05", "tag": "632bb21d-25a0-428f-9fae-d57764d2205e"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:12.242277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:12.242277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:12.251585 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-4aba13d1-c0ea-4990-bf7d-c0016a0721b1 req-63be826c-6bd0-4ae1-854d-d4840a8f6a4d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:12.252028 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-4aba13d1-c0ea-4990-bf7d-c0016a0721b1 req-63be826c-6bd0-4ae1-854d-d4840a8f6a4d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:12.263978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-4aba13d1-c0ea-4990-bf7d-c0016a0721b1 req-63be826c-6bd0-4ae1-854d-d4840a8f6a4d service nova] Creating event network-changed:632bb21d-25a0-428f-9fae-d57764d2205e for instance e4871177-efda-4482-a209-235647fa3c05 on hv-cinder-82016 Jan 21 13:55:12.269546 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-4aba13d1-c0ea-4990-bf7d-c0016a0721b1 req-63be826c-6bd0-4ae1-854d-d4840a8f6a4d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032842 Jan 21 13:55:12.270516 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 523/1065] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:12.774856 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-411705503", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "a9187b65-33d8-40b3-bd9d-eb475d6ee005"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:12.833328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] validate_networks() for [('a9187b65-33d8-40b3-bd9d-eb475d6ee005', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:55:13.191403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:13.192128 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:13.198472 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:13.198933 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:13.199731 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:13.200178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:13.341877 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:13.351326 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d32cc121-ac71-447a-854e-de5ffbcdc029 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.163905 Jan 21 13:55:13.352682 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 524/1066] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:13 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:13.413211 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:55:13.413698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:55:13.414112 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:55:13.414554 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:55:13.415066 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:55:13.425439 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:13.425890 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:13.426709 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:13.427148 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:13.444981 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Getting quotas for project 6fd8e328d18c485f9fa5af3daa7ca3e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:55:13.449354 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Getting quotas for user ce18e1ece5224dfaabd1ea719d683af6 and project 6fd8e328d18c485f9fa5af3daa7ca3e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:55:13.461130 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:55:13.463606 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:55:13.514973 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a19c6625-a9f7-4764-aa46-7751c0417499 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743668 Jan 21 13:55:13.520885 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 543/1067] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:55:13.526200 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-18c49312-92b3-4b1c-9a02-6e45ab8cde6f tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:13.527863 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-18c49312-92b3-4b1c-9a02-6e45ab8cde6f tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:13.579823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-18c49312-92b3-4b1c-9a02-6e45ab8cde6f tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:13.586245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-18c49312-92b3-4b1c-9a02-6e45ab8cde6f tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1213 microversion: 2.1 time: 0.064247 Jan 21 13:55:13.586813 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 525/1068] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:13 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:14.370169 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:14.370694 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:14.377489 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:14.377967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:14.378932 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:14.379396 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:14.603514 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:14.604134 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:14.610245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:14.610698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:14.611489 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:14.611932 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:14.625847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:14.633563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3ee1edda-177c-45a6-a4b7-0157b61d1722 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.267611 Jan 21 13:55:14.634444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 544/1069] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:14 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:14.673754 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:14.681118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7645f8b3-2ce7-449d-adf9-39702bc4f9cf tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1271 microversion: 2.1 time: 0.081240 Jan 21 13:55:14.681707 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 526/1070] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:14 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:15.651438 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:15.652874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:15.658818 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:15.659272 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:15.660064 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:15.660526 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:15.698391 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:15.699007 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:15.705374 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:15.705830 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:15.706611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:15.707047 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:15.838216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:15.846419 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b64eb93e-526e-4599-84ea-3201773d63e4 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.151578 Jan 21 13:55:15.846997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 527/1071] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:15 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:15.869278 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-00206d2f-36ff-45cf-8471-0247808f3b41 req-be3e6968-3b2a-4c1e-93c7-36dda37d4694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fc3581-82ee-4f36-ac7f-d121a0901e68", "tag": "f2996308-219c-434c-a1aa-78285d9359b0"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:15.871279 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:15.871279 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:15.886853 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-00206d2f-36ff-45cf-8471-0247808f3b41 req-be3e6968-3b2a-4c1e-93c7-36dda37d4694 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:15.887400 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-00206d2f-36ff-45cf-8471-0247808f3b41 req-be3e6968-3b2a-4c1e-93c7-36dda37d4694 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:15.899771 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-00206d2f-36ff-45cf-8471-0247808f3b41 req-be3e6968-3b2a-4c1e-93c7-36dda37d4694 service nova] Creating event network-changed:f2996308-219c-434c-a1aa-78285d9359b0 for instance 49fc3581-82ee-4f36-ac7f-d121a0901e68 on hv-cinder-82016 Jan 21 13:55:15.905349 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-00206d2f-36ff-45cf-8471-0247808f3b41 req-be3e6968-3b2a-4c1e-93c7-36dda37d4694 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039883 Jan 21 13:55:15.906013 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 528/1072] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:55:15.942153 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:15.951768 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0f456f64-b537-4e5e-9cd0-081f4661a579 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.304304 Jan 21 13:55:15.952427 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 545/1073] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:15 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:16.863982 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:16.864713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:16.870852 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:16.872399 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:16.873212 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:16.873649 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:16.968790 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:16.969402 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:16.975677 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:16.976133 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:16.976964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:16.977405 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:17.007030 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:17.014398 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8a434de5-1618-4c96-9c0f-de0cd9210371 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.154871 Jan 21 13:55:17.014997 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 529/1074] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:16 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:17.111949 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:17.119158 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a8120612-e27d-4f9f-abef-71cdf529c2ee tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.154334 Jan 21 13:55:17.119689 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 546/1075] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:16 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:18.031283 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:18.031850 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:18.041540 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:18.042390 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:18.043831 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:18.044683 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:18.136991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:18.138923 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:18.145228 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:18.145684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:18.146471 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:18.146911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:18.174519 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:18.182011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-57060175-099e-4c95-b793-a1b6ad474e81 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.154557 Jan 21 13:55:18.182588 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 530/1076] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:18 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:18.274342 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:18.281905 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-787d26b6-a909-41de-9e73-b1f716159810 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.148571 Jan 21 13:55:18.282407 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 547/1077] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:18 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:19.199147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:19.199753 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:19.206045 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:19.206483 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:19.207268 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:19.207707 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:19.301041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:19.301811 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:19.308205 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:19.309451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:19.310042 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:19.310482 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:19.344954 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:19.353464 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b6434ae7-5019-4734-9c70-0903e9dd0700 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.157965 Jan 21 13:55:19.354081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 531/1078] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:19 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:19.443025 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:19.450374 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-872d886a-4008-4091-af99-d6093abbceac tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.154945 Jan 21 13:55:19.454878 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 548/1079] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:19 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:20.371932 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:20.372542 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:20.378747 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:20.379192 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:20.379959 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:20.380387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:20.467224 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:20.467833 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:20.474249 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:20.474705 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:20.475825 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:20.476264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:20.514698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:20.521947 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-86bdfe78-80c1-4712-b792-40c571686f1b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.154234 Jan 21 13:55:20.522527 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 532/1080] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:20 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:20.610478 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:20.617402 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c8d3d9a1-809a-44a3-85a3-ae2f3a8af804 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.153891 Jan 21 13:55:20.618087 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 549/1081] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:20 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:21.539118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:21.539684 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:21.546640 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:21.547090 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:21.547869 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:21.548304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:21.634455 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:21.635071 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:21.642124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:21.642581 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:21.643370 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:21.643807 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:21.680777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:21.689191 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d5424b26-48e8-42ca-8503-e4c222ba54f5 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.153736 Jan 21 13:55:21.689777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 533/1082] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:21 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:21.773117 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:21.781487 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9dd0fd89-13ec-4dc1-9548-2407698c9069 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.150668 Jan 21 13:55:21.782061 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 550/1083] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:21 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:22.705891 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:22.706588 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:22.712815 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:22.713267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:22.714041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:22.714604 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:22.798787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:22.799403 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:22.805787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:22.806241 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:22.807024 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:22.807465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:22.846164 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:22.854611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4ac76f65-9d82-4c06-ba1d-252ed8bce3f2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.152212 Jan 21 13:55:22.856896 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 534/1084] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:22 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:22.957936 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:22.966079 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-915df34f-7c4f-4035-9813-ac2817b6b6c0 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.171086 Jan 21 13:55:22.966696 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 551/1085] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:22 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:23.874804 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:23.875413 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:23.881817 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:23.882261 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:23.883031 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:23.883460 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:23.983625 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:23.984329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:23.990831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:23.991518 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:23.992419 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:23.992933 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:24.019267 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:24.027390 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1fe158e5-2bc7-467a-9e77-69f661fe60dc tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.156609 Jan 21 13:55:24.028050 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 535/1086] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:23 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:24.128876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:24.136465 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a45c9c68-0130-44e5-bace-4cf48dda2870 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.156924 Jan 21 13:55:24.137818 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 552/1087] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:23 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:24.677350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-ec3d99f8-8a6a-4d8d-bddd-906bad822b34 req-65e92286-8cc1-47b4-bd2c-ebd0fe3a2019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fc3581-82ee-4f36-ac7f-d121a0901e68", "name": "network-vif-plugged", "status": "completed", "tag": "f2996308-219c-434c-a1aa-78285d9359b0"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:24.679275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:24.679275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:24.688555 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ec3d99f8-8a6a-4d8d-bddd-906bad822b34 req-65e92286-8cc1-47b4-bd2c-ebd0fe3a2019 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:24.689273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ec3d99f8-8a6a-4d8d-bddd-906bad822b34 req-65e92286-8cc1-47b4-bd2c-ebd0fe3a2019 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:24.702309 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-ec3d99f8-8a6a-4d8d-bddd-906bad822b34 req-65e92286-8cc1-47b4-bd2c-ebd0fe3a2019 service nova] Creating event network-vif-plugged:f2996308-219c-434c-a1aa-78285d9359b0 for instance 49fc3581-82ee-4f36-ac7f-d121a0901e68 on hv-cinder-82016 Jan 21 13:55:24.708825 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-ec3d99f8-8a6a-4d8d-bddd-906bad822b34 req-65e92286-8cc1-47b4-bd2c-ebd0fe3a2019 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035586 Jan 21 13:55:24.710089 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 536/1088] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:25.045847 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:25.046312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:25.053339 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:25.053802 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:25.054595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:25.055038 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:25.155103 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:25.155795 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:25.162372 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:25.162773 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:25.163558 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:25.163996 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:25.195910 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:25.204898 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6f0263f7-8668-4063-989c-cf5c10af42d7 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1313 microversion: 2.1 time: 0.163540 Jan 21 13:55:25.205513 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 553/1089] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:25 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:25.304008 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:25.312077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-8d3f6c6c-22c0-4314-8f58-ba26b61958f8 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.161344 Jan 21 13:55:25.312952 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 537/1090] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:25 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:26.221188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:26.221798 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:26.228113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.228559 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:26.229361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.229796 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:26.336087 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:26.336873 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:26.343151 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.343604 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:26.344380 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.344850 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:26.360510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:26.367698 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d5040a9d-854c-4ed0-b4a7-daca0bcf9168 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1497 microversion: 2.1 time: 0.150188 Jan 21 13:55:26.368258 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 554/1091] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:26 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:26.484503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:26.493249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-9a16926d-22a0-48dc-8bfa-dfb3cad2f1a7 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.160805 Jan 21 13:55:26.498851 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 538/1092] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:26 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:26.751954 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:26.752449 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:26.758944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.759489 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:26.760339 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.760819 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:26.765230 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-286997423", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452"}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:26.787986 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:55:26.818653 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] validate_networks() for None {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:55:26.867816 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f3e93e32-3669-49b8-a108-36354c0019eb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "DELETE /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 204 len: 0 microversion: 2.1 time: 0.119155 Jan 21 13:55:26.872908 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 555/1093] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:55:26 2022] DELETE /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:55:26.878018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:26.878714 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:26.884929 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.885729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:26.887671 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:26.888483 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:27.028297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:27.037456 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5dfe981f-860e-4e00-a949-f942ded9de42 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1503 microversion: 2.1 time: 0.163431 Jan 21 13:55:27.038336 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 556/1094] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:26 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:27.113911 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:55:27.114336 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:55:27.114809 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:55:27.115271 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:55:27.115680 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:55:27.126140 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:27.126569 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:27.127347 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:27.127782 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:27.144320 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Getting quotas for project c657f7c98ca848158c06784488e08f36. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:55:27.148210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Getting quotas for user 5000b84903bc4f25a202e97f3d345b4e and project c657f7c98ca848158c06784488e08f36. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:55:27.159195 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:55:27.161521 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:55:27.204623 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-6f9efb83-57e3-4ff1-bf33-126bdd5899fb tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.443574 Jan 21 13:55:27.205297 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 539/1095] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:55:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 21 13:55:27.215017 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4dbd3cdd-6113-48df-b1ac-5bb9544abac0 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:27.215630 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4dbd3cdd-6113-48df-b1ac-5bb9544abac0 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:27.267673 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4dbd3cdd-6113-48df-b1ac-5bb9544abac0 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:27.274328 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4dbd3cdd-6113-48df-b1ac-5bb9544abac0 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1214 microversion: 2.1 time: 0.063002 Jan 21 13:55:27.275142 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 557/1096] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:27 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:27.511908 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:27.512638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:27.518884 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:27.519354 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:27.520314 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:27.520863 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:27.665471 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:27.674069 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-998ec4b7-f174-4078-b994-d88b2c95643d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.166646 Jan 21 13:55:27.674636 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 540/1097] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:27 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:28.055137 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:28.055891 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:28.061775 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:28.062307 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:28.063165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:28.063725 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:28.291758 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:28.292485 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:28.299009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:28.299465 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:28.300260 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:28.300722 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:28.362295 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:28.369980 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2ad972c7-8e2b-4aae-aa1c-7038f6b3de93 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1272 microversion: 2.1 time: 0.082140 Jan 21 13:55:28.370573 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 541/1098] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:28 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:28.674887 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-291c3c87-ec08-4cac-82e1-7b2c076c3bbc req-1a93ea65-7845-42ab-8359-dd658b3ee5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4871177-efda-4482-a209-235647fa3c05", "name": "network-vif-plugged", "status": "completed", "tag": "632bb21d-25a0-428f-9fae-d57764d2205e"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:28.676559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:28.676559 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:28.689221 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-291c3c87-ec08-4cac-82e1-7b2c076c3bbc req-1a93ea65-7845-42ab-8359-dd658b3ee5b7 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:28.689882 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-291c3c87-ec08-4cac-82e1-7b2c076c3bbc req-1a93ea65-7845-42ab-8359-dd658b3ee5b7 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:28.702492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-291c3c87-ec08-4cac-82e1-7b2c076c3bbc req-1a93ea65-7845-42ab-8359-dd658b3ee5b7 service nova] Creating event network-vif-plugged:632bb21d-25a0-428f-9fae-d57764d2205e for instance e4871177-efda-4482-a209-235647fa3c05 on hv-cinder-82016 Jan 21 13:55:28.707846 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-291c3c87-ec08-4cac-82e1-7b2c076c3bbc req-1a93ea65-7845-42ab-8359-dd658b3ee5b7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036963 Jan 21 13:55:28.708849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 542/1099] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:28.716601 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:28.717592 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:28.724787 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:28.725548 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:28.727227 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:28.727867 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:28.750217 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:28.757772 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f5933b2e-70be-44f7-91b5-dc641c1bb15b tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1503 microversion: 2.1 time: 0.706189 Jan 21 13:55:28.758248 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 558/1100] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:28 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1503 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:28.890501 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:28.899467 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-99b48d6e-7006-420a-861b-fdc50c380f20 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.189288 Jan 21 13:55:28.900300 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 543/1101] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:28 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:29.387188 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:29.387791 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:29.394854 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.395307 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:29.396087 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.396521 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:29.475432 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-53bed652-c42b-4f2c-9c87-e603e9a4ee89 req-626cd6ff-8a5f-4efb-be6d-9a409bc66ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fc3581-82ee-4f36-ac7f-d121a0901e68", "name": "network-vif-deleted", "tag": "f2996308-219c-434c-a1aa-78285d9359b0"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:29.476962 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:29.476962 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:29.485700 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-53bed652-c42b-4f2c-9c87-e603e9a4ee89 req-626cd6ff-8a5f-4efb-be6d-9a409bc66ff8 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.486495 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-53bed652-c42b-4f2c-9c87-e603e9a4ee89 req-626cd6ff-8a5f-4efb-be6d-9a409bc66ff8 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:29.498142 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-53bed652-c42b-4f2c-9c87-e603e9a4ee89 req-626cd6ff-8a5f-4efb-be6d-9a409bc66ff8 service nova] Creating event network-vif-deleted:f2996308-219c-434c-a1aa-78285d9359b0 for instance 49fc3581-82ee-4f36-ac7f-d121a0901e68 on hv-cinder-82016 Jan 21 13:55:29.503077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-53bed652-c42b-4f2c-9c87-e603e9a4ee89 req-626cd6ff-8a5f-4efb-be6d-9a409bc66ff8 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031116 Jan 21 13:55:29.504335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 544/1102] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:29.513967 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:29.521433 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bf3abab4-5df4-4b1d-9206-78f2a2d4e461 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1272 microversion: 2.1 time: 0.138030 Jan 21 13:55:29.522113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 559/1103] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:29 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:29.776464 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:29.778011 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:29.784437 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.785017 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:29.785926 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.786552 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:29.832218 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.832695 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:29.833147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lazy-loading 'fault' on Instance uuid 49fc3581-82ee-4f36-ac7f-d121a0901e68 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:55:29.890449 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:29.898893 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-2d9fb135-1d8c-4e67-a422-62724d919619 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 200 len: 1303 microversion: 2.1 time: 0.126948 Jan 21 13:55:29.900178 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 545/1104] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:29 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:29.917964 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:29.919173 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:29.925939 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.926648 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:29.927617 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:29.928281 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:30.235460 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:30.242939 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5570f70d-3e65-4bcd-987c-71b63b05cebf tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1265 microversion: 2.1 time: 0.329879 Jan 21 13:55:30.243595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 560/1105] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:29 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:30.540270 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:30.540992 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:30.548001 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:30.548454 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:30.549264 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:30.549701 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:30.699158 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:30.706698 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-86b831de-a464-4274-83b2-445fca8c7e0e tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1314 microversion: 2.1 time: 0.169988 Jan 21 13:55:30.707258 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 546/1106] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:30 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:30.918952 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:30.919569 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 49fc3581-82ee-4f36-ac7f-d121a0901e68] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:30.926002 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:30.926460 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:30.927290 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:30.927733 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:30.942295 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] HTTP exception thrown: Instance 49fc3581-82ee-4f36-ac7f-d121a0901e68 could not be found. Jan 21 13:55:30.943473 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Returning 404 to user: Instance 49fc3581-82ee-4f36-ac7f-d121a0901e68 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:55:30.943741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-58c8cb75-3b8a-4763-b144-834c44cbbafe tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68" status: 404 len: 111 microversion: 2.1 time: 0.028717 Jan 21 13:55:30.944306 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 561/1107] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:30 2022] GET /compute/v2.1/servers/49fc3581-82ee-4f36-ac7f-d121a0901e68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:55:31.041377 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1097972060", "imageRef": "b11d9e99-1eff-49ae-9e17-9c064cf84c93", "flavorRef": "452", "networks": [{"uuid": "a9187b65-33d8-40b3-bd9d-eb475d6ee005"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:31.094007 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] validate_networks() for [('a9187b65-33d8-40b3-bd9d-eb475d6ee005', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:55:31.258824 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:31.259444 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:31.265648 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.266100 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.267504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.267950 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.403816 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:31.411332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2d18d7e9-75f2-4cf2-b56c-1e0759030a73 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1452 microversion: 2.1 time: 0.156094 Jan 21 13:55:31.411897 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 562/1108] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:31 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:31.427440 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:31.428166 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:31.431634 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:55:31.432086 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:55:31.432556 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:55:31.433009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:55:31.433951 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:55:31.435179 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.435729 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.436592 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.437133 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.442403 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.442872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.443676 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.444107 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.459798 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Getting quotas for project 6fd8e328d18c485f9fa5af3daa7ca3e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:55:31.463560 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Getting quotas for user ce18e1ece5224dfaabd1ea719d683af6 and project 6fd8e328d18c485f9fa5af3daa7ca3e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:55:31.474890 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:55:31.477260 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b11d9e99-1eff-49ae-9e17-9c064cf84c93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:55:31.523874 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-b51f7d8b-4911-4d0d-b3ec-d8843c1bd6e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487383 Jan 21 13:55:31.524697 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 547/1109] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:55:31.530812 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-ed759a9c-cca2-4ae4-bc41-f8431d267170 req-98f64367-91a4-4599-984f-4726bd56846d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77715ffa-fa3d-49c3-910e-11bb5ea167a0", "tag": "20338bc1-9c33-4d90-a69e-d196af1cc064"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:31.532494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:31.532494 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:31.540190 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ed759a9c-cca2-4ae4-bc41-f8431d267170 req-98f64367-91a4-4599-984f-4726bd56846d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.540668 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-ed759a9c-cca2-4ae4-bc41-f8431d267170 req-98f64367-91a4-4599-984f-4726bd56846d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.556757 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-ed759a9c-cca2-4ae4-bc41-f8431d267170 req-98f64367-91a4-4599-984f-4726bd56846d service nova] Creating event network-changed:20338bc1-9c33-4d90-a69e-d196af1cc064 for instance 77715ffa-fa3d-49c3-910e-11bb5ea167a0 on hv-cinder-82016 Jan 21 13:55:31.563246 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-ed759a9c-cca2-4ae4-bc41-f8431d267170 req-98f64367-91a4-4599-984f-4726bd56846d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036889 Jan 21 13:55:31.564247 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 548/1110] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:31.570287 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-56acd8d9-865c-43ce-bf91-a460252333c3 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:31.571332 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-56acd8d9-865c-43ce-bf91-a460252333c3 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:31.577625 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:31.585882 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8f97683c-6a75-4964-90c0-80a64de07024 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1452 microversion: 2.1 time: 0.162163 Jan 21 13:55:31.586701 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 563/1111] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:31 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:31.666304 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-56acd8d9-865c-43ce-bf91-a460252333c3 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:31.676184 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-56acd8d9-865c-43ce-bf91-a460252333c3 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1214 microversion: 2.1 time: 0.110724 Jan 21 13:55:31.685784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 549/1112] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:31 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:31.724680 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:31.725495 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:31.732451 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.733186 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.734168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:31.734828 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:31.998286 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:32.007313 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-eee4e484-6128-4a9a-9006-250d3e798cd7 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1314 microversion: 2.1 time: 0.286294 Jan 21 13:55:32.017165 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 564/1113] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:31 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:32.693824 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:32.694439 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:32.703716 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:32.704466 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:32.709366 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:32.709828 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:32.782525 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:32.789856 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1afb136a-13a7-4190-9065-b666c6c8eefb tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1272 microversion: 2.1 time: 0.099698 Jan 21 13:55:32.790695 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 550/1114] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:32 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:33.024573 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:33.025704 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:33.034333 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:33.035000 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:33.036167 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:33.036845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:33.261234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:33.269644 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c9de0ba2-ede7-4c7d-baf6-a25139d2531a tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1314 microversion: 2.1 time: 0.249200 Jan 21 13:55:33.270399 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 565/1115] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:33 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:33.387217 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-a5e110e8-b95f-439a-991c-eab0c35c0ae3 req-19a0f838-83d9-4add-ad94-7be15943c631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4871177-efda-4482-a209-235647fa3c05", "tag": "632bb21d-25a0-428f-9fae-d57764d2205e"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:33.389076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:33.389076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:33.396643 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-a5e110e8-b95f-439a-991c-eab0c35c0ae3 req-19a0f838-83d9-4add-ad94-7be15943c631 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:33.397713 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-a5e110e8-b95f-439a-991c-eab0c35c0ae3 req-19a0f838-83d9-4add-ad94-7be15943c631 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:33.410918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-a5e110e8-b95f-439a-991c-eab0c35c0ae3 req-19a0f838-83d9-4add-ad94-7be15943c631 service nova] Creating event network-changed:632bb21d-25a0-428f-9fae-d57764d2205e for instance e4871177-efda-4482-a209-235647fa3c05 on hv-cinder-82016 Jan 21 13:55:33.416118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-a5e110e8-b95f-439a-991c-eab0c35c0ae3 req-19a0f838-83d9-4add-ad94-7be15943c631 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033682 Jan 21 13:55:33.417018 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 551/1116] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:33.809019 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:33.809762 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:33.816046 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:33.816494 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:33.817317 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:33.817749 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:34.288141 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:34.289509 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:34.296416 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:34.296897 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:34.298079 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:34.298519 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:34.307595 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:34.316751 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-544c5b7c-8ada-4447-aee0-fd24a0a8f79a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1314 microversion: 2.1 time: 0.512061 Jan 21 13:55:34.320658 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 566/1117] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:33 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:34.451802 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:34.459530 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-17be963d-33eb-44e8-a8f4-c6a0d5c4d1d5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1314 microversion: 2.1 time: 0.175802 Jan 21 13:55:34.460110 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 552/1118] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:34 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:34.556995 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-f8bf5f98-e411-48c1-8049-560f0a0fdd76 req-2b6b57cf-e0da-468f-8acb-be74907ba53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5536f611-e9ec-43c6-bdc3-a66d2de4f375", "tag": "92d84b58-efdf-430d-990d-7cc66bbdddad"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:34.560532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:34.560532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:55:34.575250 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f8bf5f98-e411-48c1-8049-560f0a0fdd76 req-2b6b57cf-e0da-468f-8acb-be74907ba53d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:34.576154 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f8bf5f98-e411-48c1-8049-560f0a0fdd76 req-2b6b57cf-e0da-468f-8acb-be74907ba53d service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:34.594248 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-f8bf5f98-e411-48c1-8049-560f0a0fdd76 req-2b6b57cf-e0da-468f-8acb-be74907ba53d service nova] Creating event network-changed:92d84b58-efdf-430d-990d-7cc66bbdddad for instance 5536f611-e9ec-43c6-bdc3-a66d2de4f375 on hv-cinder-82016 Jan 21 13:55:34.606335 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-f8bf5f98-e411-48c1-8049-560f0a0fdd76 req-2b6b57cf-e0da-468f-8acb-be74907ba53d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055128 Jan 21 13:55:34.611624 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 567/1119] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:35.333934 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:35.334485 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:35.341843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:35.342294 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:35.343077 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:35.343514 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:35.477944 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:35.478647 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:35.483554 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:35.485899 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:35.486357 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:35.487152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:35.487588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:35.491517 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-f4887841-e384-433b-b49d-96f639d7c706 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1314 microversion: 2.1 time: 0.161304 Jan 21 13:55:35.497983 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 553/1120] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:35 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:35.619401 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:35.627734 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d5e10424-190e-461e-8974-e6f458e30bd3 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1314 microversion: 2.1 time: 0.154712 Jan 21 13:55:35.628391 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 568/1121] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:35 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:36.508849 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:36.509467 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:36.515822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:36.516277 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:36.517091 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:36.517533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:36.646731 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:36.646930 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:36.647484 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:36.654418 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:36.654878 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:36.655669 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-bf7c9e7e-3575-43d6-8197-0ee3e01df4c6 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1314 microversion: 2.1 time: 0.150370 Jan 21 13:55:36.655787 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:36.656103 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:36.656252 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 554/1122] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:36 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:36.710518 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-09f16118-2f2b-456d-bb02-ab383f4f7184 req-b6459712-a2a3-45f2-bc6a-6218a9f35a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77715ffa-fa3d-49c3-910e-11bb5ea167a0", "name": "network-vif-plugged", "status": "completed", "tag": "20338bc1-9c33-4d90-a69e-d196af1cc064"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:36.712066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:36.712066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:36.721905 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-09f16118-2f2b-456d-bb02-ab383f4f7184 req-b6459712-a2a3-45f2-bc6a-6218a9f35a28 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:36.722374 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-09f16118-2f2b-456d-bb02-ab383f4f7184 req-b6459712-a2a3-45f2-bc6a-6218a9f35a28 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:36.735116 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-09f16118-2f2b-456d-bb02-ab383f4f7184 req-b6459712-a2a3-45f2-bc6a-6218a9f35a28 service nova] Creating event network-vif-plugged:20338bc1-9c33-4d90-a69e-d196af1cc064 for instance 77715ffa-fa3d-49c3-910e-11bb5ea167a0 on hv-cinder-82016 Jan 21 13:55:36.740351 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-09f16118-2f2b-456d-bb02-ab383f4f7184 req-b6459712-a2a3-45f2-bc6a-6218a9f35a28 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033460 Jan 21 13:55:36.740986 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 555/1123] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:55:36.800340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:36.809434 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-77195903-fe22-4cc2-843a-e196af73c385 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1314 microversion: 2.1 time: 0.165120 Jan 21 13:55:36.809996 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 569/1124] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:36 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:37.673272 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:37.673961 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:37.679972 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:37.680417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:37.681208 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:37.681638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:37.826078 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:37.826684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:37.832601 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:37.833297 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:37.833845 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:37.834812 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:37.835343 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:37.840020 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d58ae14b-9b23-4660-a481-1a5f96811ba2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1314 microversion: 2.1 time: 0.171193 Jan 21 13:55:37.840587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 556/1125] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:37 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:37.971361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:37.979278 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-72bfc09a-0bf7-4041-99dc-5f16e43b6039 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1314 microversion: 2.1 time: 0.157085 Jan 21 13:55:37.981133 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 570/1126] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:37 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:38.856699 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:38.857216 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:38.863605 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:38.864060 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:38.864879 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:38.865319 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:38.991184 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:38.997679 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:38.998355 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:38.999310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e1cdbafa-944c-4021-9a47-9c07e39461f9 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1314 microversion: 2.1 time: 0.146450 Jan 21 13:55:39.000066 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 557/1127] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:38 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:39.004630 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:39.005118 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:39.005918 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:39.006360 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:39.141820 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:39.149104 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0cbdf27e-921c-4e94-b55b-f45f84aaefde tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1464 microversion: 2.1 time: 0.155756 Jan 21 13:55:39.149668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 571/1128] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:38 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:39.185891 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:39.186417 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:39.192108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:39.192554 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:39.193361 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:39.193793 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:39.218492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:55:39.290869 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-da931163-05a2-49d9-b18c-0566ea7cf828 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "DELETE /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 204 len: 0 microversion: 2.1 time: 0.109078 Jan 21 13:55:39.291465 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 558/1129] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:55:39 2022] DELETE /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:55:39.300635 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:39.301248 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:39.307006 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:39.307457 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:39.309500 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:39.309947 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:39.447332 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:39.455035 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5b56ca9b-c706-4e37-bbe4-be0ac09444c5 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1470 microversion: 2.1 time: 0.158107 Jan 21 13:55:39.455594 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 572/1130] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:39 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:40.017211 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:40.017917 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:40.024240 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:40.024978 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:40.025857 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:40.026328 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:40.160342 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:40.168359 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-d27834f2-7910-4b5c-a5b7-4a3d47ca732a tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1314 microversion: 2.1 time: 0.155068 Jan 21 13:55:40.168956 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 559/1131] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:40 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:55:40.472876 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:40.473420 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:40.480390 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:40.481013 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:40.481801 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:40.482244 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:40.616090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:40.623708 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b5a0a70c-3b80-47fd-8f2f-3b73d81f7379 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1470 microversion: 2.1 time: 0.154554 Jan 21 13:55:40.624598 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 573/1132] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:40 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:40.722567 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-0419053b-ddcf-4c9b-be65-9ab61a531176 req-ac50d551-e85a-41e4-a366-c4f480b4bcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5536f611-e9ec-43c6-bdc3-a66d2de4f375", "name": "network-vif-plugged", "status": "completed", "tag": "92d84b58-efdf-430d-990d-7cc66bbdddad"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:40.724181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:40.724181 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:40.736167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-0419053b-ddcf-4c9b-be65-9ab61a531176 req-ac50d551-e85a-41e4-a366-c4f480b4bcbf service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:40.736632 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-0419053b-ddcf-4c9b-be65-9ab61a531176 req-ac50d551-e85a-41e4-a366-c4f480b4bcbf service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:40.748083 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-0419053b-ddcf-4c9b-be65-9ab61a531176 req-ac50d551-e85a-41e4-a366-c4f480b4bcbf service nova] Creating event network-vif-plugged:92d84b58-efdf-430d-990d-7cc66bbdddad for instance 5536f611-e9ec-43c6-bdc3-a66d2de4f375 on hv-cinder-82016 Jan 21 13:55:40.752795 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-0419053b-ddcf-4c9b-be65-9ab61a531176 req-ac50d551-e85a-41e4-a366-c4f480b4bcbf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034013 Jan 21 13:55:40.753390 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 560/1133] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:41.186240 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:41.186861 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:41.193145 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:41.193601 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:41.194437 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:41.194874 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:41.441140 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-b67dfb2b-cdb8-4635-b7df-c917f99eebe2 req-56d3a081-93de-492e-a4ce-901daf27c333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77715ffa-fa3d-49c3-910e-11bb5ea167a0", "name": "network-vif-deleted", "tag": "20338bc1-9c33-4d90-a69e-d196af1cc064"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:41.443454 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:41.443454 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:55:41.452224 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b67dfb2b-cdb8-4635-b7df-c917f99eebe2 req-56d3a081-93de-492e-a4ce-901daf27c333 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:41.454025 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-b67dfb2b-cdb8-4635-b7df-c917f99eebe2 req-56d3a081-93de-492e-a4ce-901daf27c333 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:41.456560 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:41.465351 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-af0bb308-3cf9-4bda-a2b9-38ea26d62d21 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1314 microversion: 2.1 time: 0.284000 Jan 21 13:55:41.468960 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-b67dfb2b-cdb8-4635-b7df-c917f99eebe2 req-56d3a081-93de-492e-a4ce-901daf27c333 service nova] Creating event network-vif-deleted:20338bc1-9c33-4d90-a69e-d196af1cc064 for instance 77715ffa-fa3d-49c3-910e-11bb5ea167a0 on hv-cinder-82016 Jan 21 13:55:41.471745 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 574/1134] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:41 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:41.478647 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-b67dfb2b-cdb8-4635-b7df-c917f99eebe2 req-56d3a081-93de-492e-a4ce-901daf27c333 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043006 Jan 21 13:55:41.481273 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 561/1135] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:55:41.641948 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:41.643039 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:41.653838 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:41.654283 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:41.655596 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:41.656038 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:41.691675 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:41.692113 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:41.692812 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lazy-loading 'fault' on Instance uuid 77715ffa-fa3d-49c3-910e-11bb5ea167a0 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:55:41.733927 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000b84903bc4f25a202e97f3d345b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c657f7c98ca848158c06784488e08f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:41.743059 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2c4a235e-d866-44ad-aa09-83b9866dd7a8 tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 200 len: 1304 microversion: 2.1 time: 0.105357 Jan 21 13:55:41.743626 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 575/1136] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:41 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:42.484872 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:42.485560 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:42.491611 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:42.492055 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:42.492858 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:42.493291 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:42.622381 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:42.629621 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-5da1fb65-828a-47e9-b4a3-506249ba6d20 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1498 microversion: 2.1 time: 0.150030 Jan 21 13:55:42.630180 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 562/1137] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:42 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:42.760010 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:42.760539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] [instance: 77715ffa-fa3d-49c3-910e-11bb5ea167a0] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:42.766797 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:42.767357 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:42.768014 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:42.768458 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:42.782728 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] HTTP exception thrown: Instance 77715ffa-fa3d-49c3-910e-11bb5ea167a0 could not be found. Jan 21 13:55:42.783347 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] Returning 404 to user: Instance 77715ffa-fa3d-49c3-910e-11bb5ea167a0 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:55:42.784168 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-95357851-202a-4546-aa76-9e1a0e0b082b tempest-VolumesNegativeTest-2138457631 tempest-VolumesNegativeTest-2138457631-project] 10.222.0.84 "GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0" status: 404 len: 111 microversion: 2.1 time: 0.027975 Jan 21 13:55:42.786227 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 576/1138] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:42 2022] GET /compute/v2.1/servers/77715ffa-fa3d-49c3-910e-11bb5ea167a0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:55:43.055686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:43.056187 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:43.062404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:43.062859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:43.063673 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:43.064127 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:43.089859 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:55:43.172051 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-05e0d63d-5528-4dea-80a7-d86c8b7f236e tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 204 len: 0 microversion: 2.1 time: 0.119652 Jan 21 13:55:43.173052 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 563/1139] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:55:43 2022] DELETE /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:55:43.182186 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:43.183237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:43.189558 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:43.190018 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:43.190808 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:43.191248 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:43.335664 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:43.344378 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-94609b9e-5564-489a-81f3-324fc4887f32 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1504 microversion: 2.1 time: 0.165850 Jan 21 13:55:43.345285 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 577/1140] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:43 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:44.362777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:44.363533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:44.369862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:44.370850 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:44.371740 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:44.372180 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:44.514203 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:44.521570 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-eeb4e27a-c1c9-4e6a-9276-f38c57f64bd1 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1504 microversion: 2.1 time: 0.163131 Jan 21 13:55:44.522143 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 564/1141] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:44 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:45.128784 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-90001317-48a4-4b19-818b-c30643e3df59 req-5ea94fea-5768-4881-8d26-f827ea45b596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5536f611-e9ec-43c6-bdc3-a66d2de4f375", "name": "network-vif-deleted", "tag": "92d84b58-efdf-430d-990d-7cc66bbdddad"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:55:45.132553 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:55:45.132553 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:55:45.143312 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-90001317-48a4-4b19-818b-c30643e3df59 req-5ea94fea-5768-4881-8d26-f827ea45b596 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:45.144401 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-90001317-48a4-4b19-818b-c30643e3df59 req-5ea94fea-5768-4881-8d26-f827ea45b596 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:45.157598 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-90001317-48a4-4b19-818b-c30643e3df59 req-5ea94fea-5768-4881-8d26-f827ea45b596 service nova] Creating event network-vif-deleted:92d84b58-efdf-430d-990d-7cc66bbdddad for instance 5536f611-e9ec-43c6-bdc3-a66d2de4f375 on hv-cinder-82016 Jan 21 13:55:45.164394 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-90001317-48a4-4b19-818b-c30643e3df59 req-5ea94fea-5768-4881-8d26-f827ea45b596 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040983 Jan 21 13:55:45.165016 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 578/1142] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:55:45.540149 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:45.540803 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:45.548499 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:45.549048 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:45.549918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:45.550383 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:45.584512 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:45.585009 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:45.585415 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lazy-loading 'fault' on Instance uuid 5536f611-e9ec-43c6-bdc3-a66d2de4f375 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:55:45.630877 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce18e1ece5224dfaabd1ea719d683af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8e328d18c485f9fa5af3daa7ca3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:55:45.639068 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-1ac49a0f-f7a9-4f1b-8306-acf316619fe2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 200 len: 1304 microversion: 2.1 time: 0.103314 Jan 21 13:55:45.639745 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 565/1143] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:45 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:55:46.657654 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:55:46.658361 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] [instance: 5536f611-e9ec-43c6-bdc3-a66d2de4f375] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:55:46.664851 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:46.665302 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:46.666255 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:55:46.668203 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:55:46.680647 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] HTTP exception thrown: Instance 5536f611-e9ec-43c6-bdc3-a66d2de4f375 could not be found. Jan 21 13:55:46.681319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] Returning 404 to user: Instance 5536f611-e9ec-43c6-bdc3-a66d2de4f375 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:55:46.682150 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2053bf13-a94d-48f2-b56f-b5dda243e0e2 tempest-VolumesActionsTest-1325643354 tempest-VolumesActionsTest-1325643354-project] 10.222.0.84 "GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375" status: 404 len: 111 microversion: 2.1 time: 0.028861 Jan 21 13:55:46.682753 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 579/1144] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:55:46 2022] GET /compute/v2.1/servers/5536f611-e9ec-43c6-bdc3-a66d2de4f375 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 13:57:20.433219 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a92ccef4-8947-4771-8ab1-5bd24576bf86] AMQP server on 10.222.0.84:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 21 13:57:20.438081 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-937283832", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-264786425", "security_groups": [{"name": "tempest-secgroup-smoke-2074969604"}], "block_device_mapping_v2": [{"uuid": "12b9f221-0135-4e7d-84d0-b93156068719", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "885b2ee1-8e97-4170-97ad-c321e8aa6294"}]}} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:57:20.649135 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.network.neutron [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] validate_networks() for [('885b2ee1-8e97-4170-97ad-c321e8aa6294', None, None, None, None, None)] {{(pid=122813) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 13:57:21.019975 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Flavor limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 13:57:21.020410 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Image limits 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 13:57:21.020926 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Flavor pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 13:57:21.021341 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Image pref 0:0:0 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 13:57:21.021784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.virt.hardware [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 13:57:21.031276 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:21.031723 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:21.032537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:21.033017 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:21.049365 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 13:57:21.053245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.quota [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Getting quotas for user 0ae8a49f6ca54b8095d6ac95bd03bee0 and project 6dacb89bfd7d4537a8b5b7bc98cf5d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122813) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 13:57:21.106092 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Going to run 1 instances... {{(pid=122813) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 13:57:21.109123 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12b9f221-0135-4e7d-84d0-b93156068719',volume_size=None,volume_type=None)] {{(pid=122813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 13:57:21.226524 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-55bf01c3-7ce4-47f8-b4f9-3227d319859a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.795356 Jan 21 13:57:21.227167 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 566/1145] 10.222.0.84 () {60 vars in 1146 bytes} [Fri Jan 21 13:57:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 13:57:21.238510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-637a24f0-4188-46a0-84e4-a1e2ecffa11a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:21.239111 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-637a24f0-4188-46a0-84e4-a1e2ecffa11a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:21.295124 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-637a24f0-4188-46a0-84e4-a1e2ecffa11a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:21.301780 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-637a24f0-4188-46a0-84e4-a1e2ecffa11a tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1093 microversion: 2.1 time: 0.067918 Jan 21 13:57:21.302532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 580/1146] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:21 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:57:22.319122 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:22.319785 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:22.327818 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:22.328268 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:22.329076 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:22.329508 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:22.334913 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO oslo.messaging._drivers.impl_rabbit [-] [a92ccef4-8947-4771-8ab1-5bd24576bf86] Reconnected to AMQP server on 10.222.0.84:5672 via [amqp] client with port 43772. Jan 21 13:57:22.392624 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:22.400084 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7d241a0c-4406-4fb9-b83c-d32e2f1d2a45 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1209 microversion: 2.1 time: 0.085337 Jan 21 13:57:22.400689 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 567/1147] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:22 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:23.417097 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:23.418555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:23.425881 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:23.426330 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:23.427119 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:23.427739 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:23.572412 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 13:57:23.572949 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: Fri Jan 21 13:57:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 13:57:23.656252 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:23.664152 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-940073ea-e5f7-4a68-a3ec-397640586045 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.250723 Jan 21 13:57:23.664752 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 581/1148] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:23 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:23.728862 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [req-eb8124ba-eabd-4b0c-bdc6-51c960087bff req-a4d50d83-e13b-4733-bf38-36a557204993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd", "tag": "6741d23d-65a1-4b8e-910e-122276a04eaa"}]} {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:57:23.731666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:57:23.731666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: warnings.warn(msg) Jan 21 13:57:23.744335 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-eb8124ba-eabd-4b0c-bdc6-51c960087bff req-a4d50d83-e13b-4733-bf38-36a557204993 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:23.745382 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [req-eb8124ba-eabd-4b0c-bdc6-51c960087bff req-a4d50d83-e13b-4733-bf38-36a557204993 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:23.758488 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.compute.server_external_events [req-eb8124ba-eabd-4b0c-bdc6-51c960087bff req-a4d50d83-e13b-4733-bf38-36a557204993 service nova] Creating event network-changed:6741d23d-65a1-4b8e-910e-122276a04eaa for instance 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd on hv-cinder-82016 Jan 21 13:57:23.763943 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [req-eb8124ba-eabd-4b0c-bdc6-51c960087bff req-a4d50d83-e13b-4733-bf38-36a557204993 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040123 Jan 21 13:57:23.764840 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 568/1149] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:57:24.682957 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:24.683486 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:24.689975 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:24.690429 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:24.691243 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:24.691685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:24.738816 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 13:57:24.738983 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: Fri Jan 21 13:57:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd (ip 10.222.0.84) !!! Jan 21 13:57:24.923747 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:24.931134 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f966fc55-5125-4996-8849-b43192c7ba85 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.251914 Jan 21 13:57:24.931706 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 582/1150] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:24 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:57:25.949784 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:25.950475 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:25.956445 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:25.956918 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:25.957686 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:25.958134 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:26.097638 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:26.104925 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-db467766-6580-475c-9c29-a37d46275b7b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.159677 Jan 21 13:57:26.105492 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 569/1151] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:25 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:27.120860 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:27.121393 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:27.128417 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:27.128892 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:27.129665 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:27.130093 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:27.264269 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:27.271471 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-22d906f4-41e1-407d-ac68-f1f11be7803b tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.154339 Jan 21 13:57:27.272033 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 583/1152] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:27 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:28.288581 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:28.289213 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:28.295808 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:28.296259 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:28.297074 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:28.297515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:28.426345 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:28.433501 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-4bf1ea86-53b3-4291-9eea-1509c13d602c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.148573 Jan 21 13:57:28.434057 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 570/1153] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:28 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:29.450601 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:29.451203 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:29.457404 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:29.457865 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:29.458614 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:29.459041 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:29.593381 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:29.600555 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d2d3bd04-5caa-4412-9467-7a1aa85f39b5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.153739 Jan 21 13:57:29.601140 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 584/1154] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:29 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:57:30.617822 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:30.618421 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:30.624856 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:30.625310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:30.626089 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:30.626534 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:30.758190 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:30.765982 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-27e3cbac-a9a8-42c5-a7fa-c3f50c721835 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.151861 Jan 21 13:57:30.766542 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 571/1155] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:30 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:31.782199 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:31.782769 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:31.788943 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:31.789563 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:31.790334 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:31.790764 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:31.919417 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:31.926532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-85c54c2f-916e-4a39-b156-784bfbcd7a79 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.148124 Jan 21 13:57:31.927090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 585/1156] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:31 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:32.943618 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:32.944259 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:32.950905 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:32.951360 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:32.952153 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:32.952593 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:33.080464 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:33.087666 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-efa97832-fd81-4f45-ba8e-851204dbdb7d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.147812 Jan 21 13:57:33.088243 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 572/1157] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:32 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:33.380099 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-e0d02f7f-4557-499b-8d17-d5cf324d33e7 req-f2288b7b-76d8-4887-a88d-acce172b0e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd", "name": "network-vif-plugged", "status": "completed", "tag": "6741d23d-65a1-4b8e-910e-122276a04eaa"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:57:33.381717 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:57:33.381717 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:57:33.389101 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-e0d02f7f-4557-499b-8d17-d5cf324d33e7 req-f2288b7b-76d8-4887-a88d-acce172b0e38 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:33.389554 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-e0d02f7f-4557-499b-8d17-d5cf324d33e7 req-f2288b7b-76d8-4887-a88d-acce172b0e38 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:33.401114 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-e0d02f7f-4557-499b-8d17-d5cf324d33e7 req-f2288b7b-76d8-4887-a88d-acce172b0e38 service nova] Creating event network-vif-plugged:6741d23d-65a1-4b8e-910e-122276a04eaa for instance 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd on hv-cinder-82016 Jan 21 13:57:33.406741 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-e0d02f7f-4557-499b-8d17-d5cf324d33e7 req-f2288b7b-76d8-4887-a88d-acce172b0e38 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030409 Jan 21 13:57:33.407329 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 586/1158] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:57:34.103929 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:34.104502 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:34.110802 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:34.111261 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:34.112042 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:34.112486 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:34.241604 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:34.249552 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-cc169288-f404-4373-8b34-56bc09667c80 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1265 microversion: 2.1 time: 0.149392 Jan 21 13:57:34.250313 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 573/1159] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:34 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:35.268234 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:35.268990 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:35.275304 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:35.275754 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:35.276528 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:35.276991 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:35.411477 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:35.419090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4ab424bb-50f3-43c0-bb6e-be0c434ab257 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1452 microversion: 2.1 time: 0.155112 Jan 21 13:57:35.419866 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 587/1160] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:35 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:35.434958 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:57:35.435738 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:57:35.442387 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:35.442843 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:35.443626 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:35.444067 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:35.576839 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:57:35.584168 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e2ce9937-4a09-4810-80f6-2d371bf1f8dd tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1452 microversion: 2.1 time: 0.152911 Jan 21 13:57:35.584770 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 574/1161] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:57:35 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:57:37.408807 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-74769ce2-10dd-47c3-9fb1-473eaca8f0b8 req-cd070073-7da4-40aa-80f3-b062c76bbec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd", "tag": "6741d23d-65a1-4b8e-910e-122276a04eaa"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:57:37.410493 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:57:37.410493 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:57:37.417895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-74769ce2-10dd-47c3-9fb1-473eaca8f0b8 req-cd070073-7da4-40aa-80f3-b062c76bbec6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:57:37.418334 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-74769ce2-10dd-47c3-9fb1-473eaca8f0b8 req-cd070073-7da4-40aa-80f3-b062c76bbec6 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:57:37.438863 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-74769ce2-10dd-47c3-9fb1-473eaca8f0b8 req-cd070073-7da4-40aa-80f3-b062c76bbec6 service nova] Creating event network-changed:6741d23d-65a1-4b8e-910e-122276a04eaa for instance 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd on hv-cinder-82016 Jan 21 13:57:37.443902 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-74769ce2-10dd-47c3-9fb1-473eaca8f0b8 req-cd070073-7da4-40aa-80f3-b062c76bbec6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039357 Jan 21 13:57:37.444732 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 588/1162] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:59:16.950242 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:16.960955 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:16.968857 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:16.969385 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:16.970249 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:16.970756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:16.998353 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:59:17.025972 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-23cec984-0d66-47aa-9647-dbb5e33bba2b req-5bb1ab5d-20f8-49fc-9398-f10c2c077aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd", "tag": "6741d23d-65a1-4b8e-910e-122276a04eaa"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:59:17.027588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:59:17.027588 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:59:17.035386 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-23cec984-0d66-47aa-9647-dbb5e33bba2b req-5bb1ab5d-20f8-49fc-9398-f10c2c077aff service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:17.035939 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-23cec984-0d66-47aa-9647-dbb5e33bba2b req-5bb1ab5d-20f8-49fc-9398-f10c2c077aff service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:17.046940 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-23cec984-0d66-47aa-9647-dbb5e33bba2b req-5bb1ab5d-20f8-49fc-9398-f10c2c077aff service nova] Creating event network-changed:6741d23d-65a1-4b8e-910e-122276a04eaa for instance 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd on hv-cinder-82016 Jan 21 13:59:17.053002 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-23cec984-0d66-47aa-9647-dbb5e33bba2b req-5bb1ab5d-20f8-49fc-9398-f10c2c077aff service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100177 Jan 21 13:59:17.054015 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 589/1163] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:59:17.081530 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-218fdba8-97fb-4d54-96ae-1a8ca4b0690c tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 204 len: 0 microversion: 2.1 time: 0.136092 Jan 21 13:59:17.084693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 575/1164] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:59:16 2022] DELETE /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:59:17.092040 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:17.092895 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:17.099781 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:17.100237 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:17.101143 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:17.101771 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:17.326908 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:59:17.334613 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6e08be3c-7b2d-4fbd-9cc7-aef4705ea3f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1458 microversion: 2.1 time: 0.247359 Jan 21 13:59:17.344265 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 590/1165] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:17 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1458 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:59:18.352294 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:18.353027 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:18.359303 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:18.359756 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:18.360537 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:18.361004 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:18.494176 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:59:18.501587 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e2ffd2c5-6b3a-4733-aba0-81f895b7f8b3 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1458 microversion: 2.1 time: 0.153331 Jan 21 13:59:18.502147 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 576/1166] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:18 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1458 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:59:19.221409 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-f9eecac8-f146-4c34-8f62-ff7d01c223d8 req-f5cb577a-9c8f-4c42-94fb-1be9c3c00cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd", "name": "network-vif-deleted", "tag": "6741d23d-65a1-4b8e-910e-122276a04eaa"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:59:19.224584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:59:19.224584 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:59:19.231776 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f9eecac8-f146-4c34-8f62-ff7d01c223d8 req-f5cb577a-9c8f-4c42-94fb-1be9c3c00cc2 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:19.232290 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f9eecac8-f146-4c34-8f62-ff7d01c223d8 req-f5cb577a-9c8f-4c42-94fb-1be9c3c00cc2 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:19.244530 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-f9eecac8-f146-4c34-8f62-ff7d01c223d8 req-f5cb577a-9c8f-4c42-94fb-1be9c3c00cc2 service nova] Creating event network-vif-deleted:6741d23d-65a1-4b8e-910e-122276a04eaa for instance 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd on hv-cinder-82016 Jan 21 13:59:19.249259 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-f9eecac8-f146-4c34-8f62-ff7d01c223d8 req-f5cb577a-9c8f-4c42-94fb-1be9c3c00cc2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088195 Jan 21 13:59:19.250048 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 591/1167] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:59:19.520406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:19.521693 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:19.529065 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:19.529517 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:19.530310 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:19.530775 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:19.563206 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:19.563762 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:19.564291 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lazy-loading 'fault' on Instance uuid 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:59:19.606886 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:59:19.614777 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-e5998101-f27a-461a-88fa-f096bb28efc5 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 200 len: 1229 microversion: 2.1 time: 0.099186 Jan 21 13:59:19.615350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 577/1168] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:19 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:59:20.633026 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:20.633725 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:20.640192 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:20.640668 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:20.641442 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:20.641878 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:20.654963 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] HTTP exception thrown: Instance 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd could not be found. Jan 21 13:59:20.655539 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Returning 404 to user: Instance 5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:59:20.656350 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-75527267-6105-47b5-bcaf-dec935cb01f6 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd" status: 404 len: 111 microversion: 2.1 time: 0.028308 Jan 21 13:59:20.656909 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 592/1169] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:20 2022] GET /compute/v2.1/servers/5f8f39d5-4a18-4fe2-a400-bd1f2cb97bbd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:59:23.948232 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:23.948832 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:23.949831 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-a072ec5a-1982-441a-92d4-34545e193621 req-3b597ea1-5697-469e-9492-ab5becde3081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4871177-efda-4482-a209-235647fa3c05", "tag": "632bb21d-25a0-428f-9fae-d57764d2205e"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:59:23.951620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:59:23.951620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:59:23.954823 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:23.955275 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:23.956374 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:23.956916 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:23.960778 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a072ec5a-1982-441a-92d4-34545e193621 req-3b597ea1-5697-469e-9492-ab5becde3081 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:23.961300 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a072ec5a-1982-441a-92d4-34545e193621 req-3b597ea1-5697-469e-9492-ab5becde3081 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:23.975911 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-a072ec5a-1982-441a-92d4-34545e193621 req-3b597ea1-5697-469e-9492-ab5becde3081 service nova] Creating event network-changed:632bb21d-25a0-428f-9fae-d57764d2205e for instance e4871177-efda-4482-a209-235647fa3c05 on hv-cinder-82016 Jan 21 13:59:23.981356 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-a072ec5a-1982-441a-92d4-34545e193621 req-3b597ea1-5697-469e-9492-ab5becde3081 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035280 Jan 21 13:59:23.981533 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Going to try to terminate instance {{(pid=122813) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 13:59:23.982193 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 593/1170] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 13:59:24.067172 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7f130555-96f9-43ec-ac4a-c2df244adf26 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "DELETE /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 204 len: 0 microversion: 2.1 time: 0.122220 Jan 21 13:59:24.069191 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 578/1171] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:59:23 2022] DELETE /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 13:59:24.077898 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:24.083438 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:24.091160 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:24.091620 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:24.092482 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:24.093340 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:24.311504 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:59:24.319702 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-39f37ee0-fd19-4756-8410-335a253cf09d tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1577 microversion: 2.1 time: 0.246065 Jan 21 13:59:24.324810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 594/1172] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:24 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1577 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 13:59:25.337953 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:25.338650 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:25.344898 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:25.345350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:25.346127 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:25.347210 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:25.477041 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:59:25.484350 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-ed34ed3f-da4b-4d6a-9c11-a8978838e221 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1458 microversion: 2.1 time: 0.150585 Jan 21 13:59:25.484950 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 579/1173] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:25 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1458 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:59:26.001210 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-3099c660-1ad7-46da-9235-b58fb08ba5e8 req-a9969204-d467-4843-a7c1-f49ae7d3e796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4871177-efda-4482-a209-235647fa3c05", "name": "network-vif-deleted", "tag": "632bb21d-25a0-428f-9fae-d57764d2205e"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 13:59:26.003824 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 13:59:26.003824 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Jan 21 13:59:26.013094 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-3099c660-1ad7-46da-9235-b58fb08ba5e8 req-a9969204-d467-4843-a7c1-f49ae7d3e796 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:26.013547 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-3099c660-1ad7-46da-9235-b58fb08ba5e8 req-a9969204-d467-4843-a7c1-f49ae7d3e796 service nova] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:26.025139 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-3099c660-1ad7-46da-9235-b58fb08ba5e8 req-a9969204-d467-4843-a7c1-f49ae7d3e796 service nova] Creating event network-vif-deleted:632bb21d-25a0-428f-9fae-d57764d2205e for instance e4871177-efda-4482-a209-235647fa3c05 on hv-cinder-82016 Jan 21 13:59:26.031264 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-3099c660-1ad7-46da-9235-b58fb08ba5e8 req-a9969204-d467-4843-a7c1-f49ae7d3e796 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Jan 21 13:59:26.031851 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 595/1174] 10.222.0.84 () {64 vars in 1317 bytes} [Fri Jan 21 13:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 13:59:26.502033 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:26.503146 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:26.509876 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:26.510325 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:26.511108 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:26.511544 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:26.543585 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:26.543962 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:26.544406 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.objects.instance [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lazy-loading 'fault' on Instance uuid e4871177-efda-4482-a209-235647fa3c05 {{(pid=122813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 13:59:26.588386 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.policy [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae8a49f6ca54b8095d6ac95bd03bee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dacb89bfd7d4537a8b5b7bc98cf5d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122813) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 13:59:26.596515 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-deeaa86a-9398-4761-b2bb-fbea378f219f tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 200 len: 1229 microversion: 2.1 time: 0.097945 Jan 21 13:59:26.597404 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 580/1175] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:26 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 13:59:27.614225 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:27.614916 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: e4871177-efda-4482-a209-235647fa3c05] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:27.621375 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:27.621763 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:27.622532 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:27.622961 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:27.635510 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] HTTP exception thrown: Instance e4871177-efda-4482-a209-235647fa3c05 could not be found. Jan 21 13:59:27.636084 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Returning 404 to user: Instance e4871177-efda-4482-a209-235647fa3c05 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:59:27.636914 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-32825849-7776-4e1e-9978-a23a49a3a690 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05" status: 404 len: 111 microversion: 2.1 time: 0.027027 Jan 21 13:59:27.637430 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 596/1176] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:27 2022] GET /compute/v2.1/servers/e4871177-efda-4482-a209-235647fa3c05 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:59:28.081447 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:28.082050 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.compute.api [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122813) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:28.088272 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:28.088781 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:28.089564 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:28.090005 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG oslo_concurrency.lockutils [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:28.102847 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.wsgi [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] HTTP exception thrown: Instance b269ee40-e090-4ad6-a652-0188bd06fa08 could not be found. Jan 21 13:59:28.103432 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Returning 404 to user: Instance b269ee40-e090-4ad6-a652-0188bd06fa08 could not be found. {{(pid=122813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:59:28.104245 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-7fb7deaf-8996-4999-b32d-d80dbaae9461 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "DELETE /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 404 len: 111 microversion: 2.1 time: 0.027109 Jan 21 13:59:28.104792 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 581/1177] 10.222.0.84 () {58 vars in 1238 bytes} [Fri Jan 21 13:59:28 2022] DELETE /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:59:28.113204 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:28.113810 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] [instance: b269ee40-e090-4ad6-a652-0188bd06fa08] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 13:59:28.119571 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:28.120016 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:28.120804 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 13:59:28.121239 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Lock "015249c4-915d-4c7c-ba7f-761b11b5af70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 13:59:28.134585 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] HTTP exception thrown: Instance b269ee40-e090-4ad6-a652-0188bd06fa08 could not be found. Jan 21 13:59:28.135154 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Returning 404 to user: Instance b269ee40-e090-4ad6-a652-0188bd06fa08 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 13:59:28.135949 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f2bcad0e-468a-4194-804b-c67816fe8ced tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08" status: 404 len: 111 microversion: 2.1 time: 0.026963 Jan 21 13:59:28.136460 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 597/1178] 10.222.0.84 () {58 vars in 1235 bytes} [Fri Jan 21 13:59:28 2022] GET /compute/v2.1/servers/b269ee40-e090-4ad6-a652-0188bd06fa08 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 13:59:29.411970 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: DEBUG nova.api.openstack.wsgi [None req-c23aee2b-41c7-4ba9-9534-f3ecc6347097 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] Calling method '.version_select at 0x7f51bc055160>' {{(pid=122813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 13:59:29.437575 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO nova.api.openstack.requestlog [None req-c23aee2b-41c7-4ba9-9534-f3ecc6347097 tempest-TestVolumeBootPattern-1011988831 tempest-TestVolumeBootPattern-1011988831-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-264786425" status: 202 len: 0 microversion: 2.1 time: 0.030303 Jan 21 13:59:29.438053 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: [pid: 122813|app: 0|req: 582/1179] 10.222.0.84 () {58 vars in 1259 bytes} [Fri Jan 21 13:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-264786425 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 14:00:24.605319 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:00:24.605960 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: Fri Jan 21 14:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:00:25.357121 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:00:25.357727 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: Fri Jan 21 14:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:00:44.748089 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:00:44.748684 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: Fri Jan 21 14:00:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:02:22.591503 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:02:22.592118 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: Fri Jan 21 14:02:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:02:23.583871 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:02:23.584090 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: Fri Jan 21 14:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:02:25.203284 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:02:25.203851 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: Fri Jan 21 14:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:03:44.613090 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:03:44.613809 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: Fri Jan 21 14:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:03:45.365189 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:03:45.365734 dv-cinder-820164-2-iscsi devstack@n-api.service[122813]: Fri Jan 21 14:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 14:04:04.755685 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 14:04:04.756311 dv-cinder-820164-2-iscsi devstack@n-api.service[122814]: Fri Jan 21 14:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!